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LETTER OF TRANSMITTAL 


To Members 
Department of Supervisors and Directors of Instruction 
National Education Association: 


Herewith is submitted for your consideration the Fourth 
Yearbook of our Department. The purpose of the yearbook is 
to stimulate thinking concerning the values to be derived from 
supervisory activities and the methods of evaluating the effects 
of such activities. This yearbook is in part theoretical, in part 
a summarization of published investigations, and in part a com- ~ 
pilation of the investigations and supervisory activities under- 
taken by the membership of the Department. The report as 
submitted represents group thinking rather than the thinking of 
the individual member preparing a given chapter. 

Your Committee is highly appreciative of the funds made 
available by your Executive Committee for use in connection 
with the preparation of this yearbook. The Committee is also 
greatly indebted to Professor James F. Hosic of Teachers Col- 
lege, Columbia University, Executive Secretary of this Depart- 
ment, who attended most of the meetings of your Committee 
and offered countless valuable suggestions. Your Committee also 
expresses its appreciation to those members of this Department 
who have contributed to the production of this volume. 


Respectfully submitted 


De.ia E. Kisse 

Georce C. Kyte 

RupoueH D. LInpaQuist 
WortH McCuure 

J. R. McGaucuy 

JANE MINGo 

Pau T. RANKIN 

CuirForD Woopy, Chairman 























PREFACE 
PURPOSE OF YEARBOOK 


This yearbook is the fourth volume of a series published under 
the auspices of the now-named Department of Supervisors and 
Directors of Instruction on the general problem of supervision 
of instruction. As pointed out in Chapter I of this volume, the 
first yearbook was given the general title, Educational Super- 
vision; the second, Scientific Method in Supervision; and the 
third, Current Problems of Supervisors. The fourth yearbook, 
The Evaluation of Supervision, is closely related to some of the 
problems and issues raised in the previous volumes. Since each 
of the previous yearbooks devoted limited space to the evalua- 
tion of supervision, the fourth yearbook may well be thought of 
as an extension and elaboration of some of the problems and 
issues raised in those volumes. 

In planning the present yearbook, the committee had several 
purposes in mind: (1) to outline the criteria which should be 
applied in the evaluation of supervision; (2) to present in simple 
outline the procedures which are essential in the scientific evalua- 
tion of supervision; (3) to review the existing literature dealing 
with the scientific evaluation of the effects of supervision and 
to present, with a few of the outstanding findings, a summary 
and criticism of the procedures and techniques employed; (4) 
to make a tabulation of investigations conducted by the mem- 
bership of this Department in which there was effort to evaluate 
the effects of supervisory activities; and (5) to develop a check 
list by which those engaged in supervision can make a self- 
evaluation of their own work. 

In the last analysis, the committee in charge of this yearbook 
had in mind the purpose of stimulating those occupying super- 
visory positions to undertake the evaluation of their activities 
on a more extensive scale than in the past and the use and 
application of more refined techniques and procedures of educa- 


tional experimentation. 
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vi PREFACE 


PREPARATION OF THE YEARBOOK 


This fourth yearbook, like those in previous years, is a codper- 
ative enterprise. First, it represents codperation between the 
membership of this Department and the committee; and sec- 
ondly, codperation among the membership of the committee 
itself. In planning the yearbook, the committee set to work 
with two guiding assumptions in mind: that since this was a year- 
book of the Department of Supervisors and Directors of Instruc- 
tion, supervisors and directors should be called upon to make 
contributions; that each chapter should represent the codperative 
efforts and should have the sanction of the committee as a whole 
rather than be the contribution of the person assuming responsi- 
bility for its preparation. 

On the basis of the first assumption, three inquiry blanks, 
which had been prepared and approved by the committee, were 
sent to the membership of this Department. These question- 
naires asked for information concerning: (1) recent investiga- 
tions undertaken within the various school systems primarily 
for the purpose of objectively evaluating supervisory activities 
per se; (2) projects or investigations stimulated or initiated by 
supervisors, in which the method of learning or teaching and not 
supervision itself was the variable, and in which the means of 
evaluation was more subjective than in the previously enumer- 
ated type of investigation; and (3) case studies describing how 
a supervisor had helped a poor teacher become a better teacher 
and giving the means of measurement used in determining 
whether the teacher really became a better teacher. The com- 
mittee also asked certain members of the Department to furnish 
descriptions of how they launched, maintained, and appraised 
supervisory programs in selected school units. 

Proceeding on the second guiding assumption, the committee 
held two meetings: at Buffalo on January 18 and at Atlantic 
City on February 23 and 24, during which plans and outlines 
for the yearbook were made codperatively and the assignments 
for the preparation of preliminary drafts of the different chap- 
ters were given. The committee met in Detroit on June 14 and 
15 for purposes of reviewing the progress made in preparation 
of the yearbook and to consider any modifications in the pro- 
posed plans and assignments. A meeting held in Detroit on 
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September 22 and 23 was devoted to final review of the various 
reports to be submitted. 


DIvISION oF LABOR 


While the contents of the various chapters have the general 
approbation of the committee as a whole, individual members 
were held responsible for the preparation and final revision of 
the different chapters. Those members responsible for the 
different chapters are as follows: Chapter I, Worth McClure; 
Chapters II and III, Paul T. Rankin; Chapters IV and V, 
George C. Kyte; Chapter VI, Delia Kibbe; Chapter VII, Jane 
Mingo; Chapter VIII, J. R. McGaughy; Chapter IX, and Bibli- 
ography, Clifford Woody. Mr. Lindquist was not given a definite 
assignment in the preparation of a given chapter, but rendered 
valuable service by criticizing the suggested plans for various 
chapters and by his comments on the preliminary drafts thereof. 

It seems fitting, in discussing the preparation of the yearbook, 
to add that Worth McClure deserves a large share of the credit 
for the early stages of its preparation. He was originally chair- 
man of the committee and was largely responsible for the selec- 
tion of the committee. During the time in which he was serving 
as chairman, the yearbook was planned and the preliminary 
drafts of the chapters were reviewed. If the planning of a 
task, as someone has said, constitutes half of its solution, he 
is responsible for a good share of this year’s contribution. The 
committee regrets that his election as superintendent of schools 
in Seattle necessitated his relinquishing the chairmanship. 
Although his retirement and the appointment of the present 
chairman caused some reassignments in the preparation of the 
chapters, the yearbook as a whole is presented approximately as 
conceived by the committee during Mr. McClure’s period of 
leadership. 
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CHAPTER I 
DEFINITION OF THE PROBLEM 


How may supervisory activities be evaluated? This is the 
problem to which this yearbook is addressed. 


What are supervisory activities? The meaning of the 
term supervisory is naturally an important consideration. The 
committee includes within the scope of this term all activities 
by which educational officers may express leadership in the im- 
provement of learning and teaching. Such activities as obser- 
vation of classroom instruction, conduct of teachers’ meetings 
and of group and individual conferences are clearly within the 
meaning of this term. The development and execution of plans 
looking toward increased effectiveness in reading, arithmetic, or 
some other area of the school program, and the organization or 
reorganization of curriculum and method are still further ex- 
amples of what is meant by supervisory activities. 


Measurement and evaluation distinguished. The committee 
makes a clear distinction between measurement, or description, 
and evaluation. Two individuals, for example, may witness the 
same classroom activity. They may both agree afterward as to 
the important details of what occurred. Objective measures as 
to the results may be accepted by both without question. Never- 
theless, these two observers may—and in practice frequently 
do—disagree most heartily as to the value of the activities con- 
cerned and of the measured or described results which both have 
accepted. This disagreement will arise because of widely differ- 
ent standards of value derived from opposing philosophies of 
education. 


Limitations of the field of this study. Since studies of super- 
visory activities of principals and superintendents are already 
being made by other organizations,’ the committee has regarded 


1See yearbooks of the Department of Elementary School Principals and of 
the Department of Superintendence of the National Education Association, 
1201 Sixteenth Street, Washington, D. C. 
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its field as properly limited to supervisory activities conducted 
by educational officers usually known as general supervisors, 
subject supervisors, or directors of instruction within elementary 
and secondary schools. 


CoMPLICATING FACTORS 


The organization of supervision. From the preceding discus- 
sion, it will be observed that the problem is by no means a simple 
one. Supervisory activities involve the codperative participation 
of other persons than the supervisor himself. The teacher must 
assuredly be thought of as one of these. The relationship of the 
supervisor to the teacher thus becomes a factor of primary im- 
portance. Other persons and agencies that may be involved are 
superintendents, principals, other supervisors, departments of 
research, and specialized services such as psychiatric clinics and 
medical departments. Clearly the relationship of supervisors to 
each of these, as embodied in the type of supervisory organiza- 
tion employed, is a limiting factor. The relationship of the 
supervisor and the building principal will illustrate this point. 
If Supervisor A, for example, has the status of assistant super- 
intendent, and as such outranks the principal in matters of 
instruction, his problem is obviously different from that of 
Supervisor B, who is regarded merely as an advisory expert and 
who has no direct authority over principals or teachers. Both 
the approach and the procedures of Supervisor B are likely to 
be different from those of Supervisor A. 

According to Ayer and Barr,? there are three general types of 
supervisory organizations, which they designate as the dualistic 
type, the line and staff type, and the codrdinate type. 

The first of these involves a dual leadership. The teacher is 
responsible to the principal for general management, and to the 
supervisor for instructional efficiency.® 

Under the second type, the principal as a line officer is re- 
garded as primarily responsible for the satisfactory functioning 


a Ayer, F. C., and Barr, A. S., Organization of Supervision. New York: D. 
Appleton and Co., 1928. 

®¥For a fuller discussion of types of supervisory organization, see Ayer, F. C., 
and Barr, A. S., op. cit.; also The Superintendent Surveys Supervision, Bighth 
Yearbook, Department of Superintendence, N. E. A., Washington, D. C., 1930; 
and Kyte, George C., How to Supervise (Boston: Houghton Mifflin Co., 1930), 
Chap. III. 
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of his school. Authority flows directly from the superintendent 
or assistant superintendent through the principal to the teachers. 
The supervisor is regarded as a consulting expert with no direct 
authority over either principal or teacher, but the principal is 
required to use supervisory assistance if he finds himself unable 
or unqualified to direct the instruction effectively. His responsi- 
bility for the quality of all instruction makes him accountable 
for the use of all resources at his command, including that of 
central supervision. The supervisor is thus shorn of adminis- 
trative power and his functioning is conditioned directly by his 
ability to convince principals and teachers of his ability to serve. 

Under the third type, little attempt is made to separate super- 
visory and administrative functions. Both supervisors and 
principals function directly under the central administrative staff 
and emphasis is placed upon codrdination and integration. 

For the purposes of this study it will be sufficient to point out 
that any given set of supervisory activities may be found effec- 
tive under one type of organization and quite ineffective under 
another type. Thus each attempt at evaluation must be made 
in the light of the organization of supervision in the situation 
under consideration. 

Size of systems. Another group of factors which condition the 
effectiveness of a given set of supervisory activities and which 
must, therefore, be considered in seeking to evaluate them are 
those which arise out of the size and character of the system in 
which the supervisor serves. Among these considerations are 
the following: 

1. The larger the system, the greater the degree of specializa- 
tion permissible. Recent studies indicate that this possibility 
is realized in practice.* Thus in the small system the supervisor 
of kindergarten-primary work may also be compelled, because 
of economic or other considerations, to assume the urection of 
fine and industrial arts in all the grades within the system. 

2. The larger the system, the larger the individual schools, as 
a general rule. The size of school units is an important con- 
sideration. In the smaller communities individual schools tend 
to be small and the supervisor spends relatively more of his time 
in travel from station to station than he would in supervising 


*Kyte, George C., How to Supervise. Boston: Houghton Mifflin Co., 1930, 
p. 65. 
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the same number of teachers in a large system. The extreme of 
this is encountered in some rural sections where one-teacher 
schools prevail. Supervisors in small systems, moreover, fre- 
quently may expect to receive less codperation from principals, 
since the latter often teach during some portion of, or perhaps 
the entire, day. These considerations necessarily modify the 
effectiveness of specific supervisory activities. 

3. The larger the system, the more influential the supervisor’s 
position. In the small system the supervisor may be merely a 
traveling teacher, with little prestige or authority except such as 
he is able to acquire through his own efforts. He must find 
different ways of exercising leadership from those employed by 
the supervisor in the large system, whose right of leadership is 
generally acknowledged. 

4. The larger the system, the more adequate, as a general rule, 
are the economic resources as expressed in terms of material 
conditions. 

The foregoing statements will serve to emphasize the impor- 
tance of the size of the school system as a complicating factor. 


The varying philosophy of supervisors. Consciously or other- 
wise, every individual determines values in terms of his own 
personal philosophy. Supervisors are not exceptions to this prin- 
ciple when they plan their professional undertakings and when 
they consider critically the results of their leadership. Personal 
and professional philosophies vary among supervisors, with con- 
sequent disagreement as to what is good, both in technics and in 
results. 

While it may be said that an integration of existing philoso- 
phies is a “consummation devoutly to be wished” in American 
education, a much more serious indictment is the lack of true 
standards of value that is implied by the Report of the Third 
Yearbook Committee.» Too much emphasis, according to this 
report, is placed upon lesser values, such as devices and methods, 
and not enough upon higher values, such as interpretation of 
aims, capitalization of creative abilities of individual teachers, 
and other major considerations. The following excerpts from the 
summary chapter are pertinent: 


5 Current Problems of Supervisors. Third Yearbook, Department of Super- 
visors and Directors of Instruction, Chapter XI. New York: Teachers College, 
Columbia University, 1930. 
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Neither teachers nor supervisors evinced much interest in the interpreta- 
tion of aims or objectives. Barely two per cent of the problems attacked 
by supervisors on their own initiative fell into this class. 


These data indicate little effort toward finding latent talent. When 
supervisors were left to their own initiative, two per cent of the problems 
they attacked involved experimentation that draws out latent talent. 


The evidence points unmistakably to the fact that teachers will respond 
to a high quality of supervisory leadership; yet, left to their own resources, 
they will tend to succumb to the influence of minor problems, such as, 
pupil conduct, use of devices, and daily routine. 


Other complicating factors. Among the considerations which 
must also be weighed in evaluating supervisory activities are 
those of a geographical and social nature. The extent of the 
geographical area served by the supervisor will affect his pro- 
cedures in many ways. He will be limited somewhat definitely 
in his employment of such devices as meetings, for example, by 
the area of his district and the quality of transportation facili- 
ties. The character of the population in terms of natural and 
racial inheritance, the attitude of the community toward educa- 
tion in general and toward supervision in particular, are sug- 
gestive of other complicating factors which must be recognized 
in evaluating procedures. 


Tue NEeEpD For EVALUATION 


Fundamentally, supervision as it is now conceived may be 
said to have arisen out of the fact that American teachers have 
been under-trained.® As evidence of this we have only to note 
the continued tendency, which still exists, to lengthen the period 
of professional training. 

The addition of special subjects to the curriculum in the latter 
part of the nineteenth century called for the services of subject 
specialists to instruct the teachers in order to assure the effective 
presentation of those subjects. In the meantime the gradual 
enrichment and expansion of the school program has proceeded 
rapidly, whilst the contributions of research to curriculum and 
method have made it necessary to carry on a continual program 
of training in service if the great body of instructors is to be 
kept abreast of educational progress in a changing civilization. 


*Barr, A. 8., and Burton, W. H., Supervision of Instruction. New York: D. 
Appleton and Co., 1926. 
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To the need for continual training in service, however, must be 
added others of equal importance—the need for codrdination 
of effort within a system of schools, and the need for maintain- 
ing an attitude of alert sensitiveness to new problems and of 
zeal for their solution. 

Because of the comparative recency of its establishment, how- 
ever, professional supervision is still frequently challenged by 
laymen and by teachers. Administrators who have to face de- 
mands for retrenchment in school expenses are honestly critical. 
Thoughtful supervisors themselves are constantly examining 
their own efforts with a critical eye in order to appraise results, 
to determine which technics are the most effective, and what the 
factors are which condition effectiveness in given situations. 
Of this attitude on the part of modern supervisors, the frequency 
of its expression in educational literature and especially in the 
yearbooks of this organization are concrete evidence. The com- 
mittee, therefore, believes that study of the evaluation of super- 
vision is particularly appropriate at the present time. 


Can supervision be justified economically? The challenge of 
the layman, reasonably enough, is often made upon economic 
grounds. The addition of supervisors to the payroll has meant 
some addition to school expenditures, although usually this is 
not so onerous as many have believed. Furthermore, the layman 
regards supervision as something new and extrinsic. Therefore, 
when demands for economy are made upon the schools, the 
supervisory staff is one of the earliest targets of attack. Not 
infrequently some teachers join in the general challenge. That 
supervision is better than no supervision is often questioned. 
It is very necessary, therefore, from the economic viewpoint, 
that supervision give an accounting. 


Can supervision be justified educationally? Mention of the 
challenging attitude of teachers has already been made. Survey 
of the literature upon this subject’ reveals the following criti- 
cisms by the teaching staff: 

1. Supervision does not give sufficient encouragement to and 
opportunity for the creative abilities of teachers. 

2. Supervision is frequently inspectional only. 


‘Barr, A. S., and Burton, W. H., op. cit., pp. 495-503. 
The Superintendent Surveys Supervision, Chap. VI. Eighth Yearbook, De- 
partment of Superintendence, N. E. A., 1930. 
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3. Supervision is frequently theoretical rather than practical 
and, therefore, makes unreasonable demands of teachers. 

4. Supervision is poorly planned. 

That some administrators question sympathetically but 
frankly the necessity of supervision is evidenced by the recent 
publication by the Department of Superintendence of a yearbook 
containing three chapters bearing directly thereupon.* 

Showing of educationally valuable results from supervisory 
activities will effectively answer the challenges of laymen, 
teachers, and administrators. Supervisors consequently are 
vitally concerned in setting up procedures for evaluation. 


Can the most effective supervisory procedures be determined? 
The answer to this question is of especial concern to profes- 
sionally alert supervisors. Are group meetings of greater effec- 
tiveness than individual conferences, or are supervisory bulletins 
more productive than either under certain conditions? Is there 
a different ranking of effectiveness of these three types of activity 
when the complicating factors are altered? These are questions 
of the kind that must be answered if the most effective pro- 
cedures are to be discovered. 

In summary of the need for evaluation, then, it may be said 
that this study must be concerned with: 

1. Evaluation of the results of supervision as contrasted with 
those of no supervision. 

2. Comparative evaluation of different types of supervisory 
procedure with a view to the discovery of the most effective. 


RELATION OF THIS YEARBOOK TO Previous STUDIES 


While this is the first professional yearbook to be devoted 
entirely thereto, it is not contended that it represents the first 
approach to the evaluation of supervision. Individuals® have 


* Bighth Yearbook, Department of Superintendence, N. EB. A., Chaps. I, VI, VII. 

* Barr, A. S., and Burton, W. H., The Supervision of Instruction. New York: 
D. Appleton and Co., 1926. 

Kyte, George C., How to Supervise. Boston: Houghton Mifflin Co., 1930. 

Nutt, H. W., Current Problems in the Supervision of Instruction. Richmond, 
Va.: Johnson Publishing Co., 1928. 

Scott, C. E., Educational Supervision. Milwaukee: Bruce Publishing Co., 
1924. 

Wagner, C. A., Common Sense in School Supervision. Milwaukee: Bruce 
Publishing Co., 1921. 

The Superintendent Surveys Supervision. Eighth Yearbook, Department of 
Superintendence, National Education Association, Washington, D. C., 1930. 
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already contributed much and other organizations have included 
the problem as one phase of their studies of supervision. 

Previous yearbooks of this Department * have made signifi- 
cant contributions. The First Yearbook, Educational Super- 
vision, a general treatment, contained a chapter by W. H. 
Burton upon “The Evaluation of Supervision” and one section 
comprised a valuable symposium upon the philosophy of super- 
vision by Bobbitt, Courtis, and Kilpatrick. The Second Year- 
book, Scientific Method in Supervision, emphasized objective 
techniques for recording activities and results of instruction. 
The Third Yearbook, Current Problems of Supervisors, made a 
further contribution by pointing out certain types of supervisory 
activities which are definitely helpful to teachers. A significant 
contribution to the development of criteria for the evaluation of 
supervision was made by the formulation of supervisory prin- 
ciples. Furthermore, certain definite questions were raised by 
the summary chapter with reference to the effectiveness of 
various organization types or supervisory techniques. The 
Fourth Yearbook, by attacking the specific problem of evalua- 
tion, therefore, is a natural outgrowth of previous studies of this 
Department, and should lay the foundation for extensive experi- 
mental studies which may constitute a future yearbook. 


Department of Supervisors and Directors of Instruction, National Educa- 
tion Association. First Yearbook, Educational Supervision, 1928. Second 
Yearbook, Scientific Method in Supervision, 1929. Third Yearbook, Current 
Problems of Supervisors, 1930. New York: Teachers College, Columbia Uni- 
versity, Bureau of Publications. 




















CHAPTER II 
CRITERIA FOR THE EVALUATION OF SUPERVISION 


The amount of reliable evidence which is available as to the 
worth of supervision in general or of specific supervisory plans 
is not large. Many of the opinions which are expressed as to 
the value of supervision are efforts to generalize from more or 
less uncritical, day-to-day experience and do not rest upon a 
scientific determination of the facts. Further, these opinions 
as to the value of supervision differ greatly with the different 
people who express them. The chief reason for the unreliability 
of so much of the available evidence and for this difference in 
opinion is to be found very largely in the diversity of the criteria 
used. 
The purpose of this chapter is to present in definite terms a 
number of proposed criteria for the evaluation of supervision. 
Criteria as here used mean nothing more nor less than bases of 
judgment. The determination of the worth of supervision in 
general or of any specific supervisory program or activity in 
particular, must be made with reference to one or more bases of 
judgment. 

Consciously or unconsciously the standard of values held by 
the person judging a supervisory program, or its expression in 
a specific situation, molds in a distinctive way his final rating 
of the activities observed. One observer of conditions may pay 
much attention to the morale of the teaching corps; another, 
very little to morale but very much more to the amount of 
learning accomplished by the children. Evidently if two such 
observers attempt to evaluate a given program of supervision, 
they will do so with very different outcomes. If the program is 
one which is conspicuous for its emphasis upon the development 
of teacher-morale, the first observer will rate it very high and 
the second may rate it very low. If, on the other hand, the 
program is one which results in a large amount of pupil growth 
but has little or no effect upon teacher-morale, the second 

11 
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observer will probably consider it much better than will the first. 
Thus, whatever may be the character of the program or activity 
observed, it is very largely the standard of values used as a 
basis of judgment which determines the final evaluation. 

The selection and weighting of criteria constitute a first and 
vitally important step in the evaluation of supervision. Not 
only must the criteria be chosen wisely, but also provision must 
be made for weighting them differently in terms of their relative 
significance. 


Tup RELATION BETWEEN MEASUREMENT AND EVALUATION 


In Chapter I of this yearbook reference was made to the dis- 
tinction between the two terms, measurement and evaluation. 
This distinction should be perfectly clear. By measurement is 
meant the description of the significant elements or characteris- 
tics of the item which is being measured. Obviously measure- 
ment can be concerned at any one time with but a single 
characteristic of the item under consideration. Ideally, the 
products of measurement are objective, impartial, and imper- 
sonal—independent in large degree of all standards of worth. 
By evaluation is meant appraisal, or the judgment of the worth 
of the item as a whole, with reference to some adopted purpose. 
Such a judgment is built up from independent judgments on the 
separate characteristics of the item by combining them on the 
basis of an adopted plan of weighting. The products of evalua- 
tion, in contrast with those of measurement, are always colored, 
i.e., almost completely dependent upon the standard of values 
adopted. 

In each of these activities—measurement and evaluation— 
criteria broadly conceived have an important part to play. If 
we confine our attention to measurement, the criteria determine 
those elements or characteristics which shall be considered sig- 
nificant and, therefore, described. When we turn to evaluation, 
the criteria which we have adopted determine the acceptability 
of the characteristics or elements, and finally of the whole item 
itself. 


As an illustration, we may think of the reactions of a group 


1For an early and clear statement of the meanings of these two terms, see 
Courtis, S. A., “Possibilities and Potentialities in Measuring the Work of a 
Principal,’’ American School Board Journal, LXXIII (December, 1926), p. 37 ff. 
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of picnickers on the one hand and those of a farmer on the 
other to a rain storm which occurs at a given time. If the group 
are just starting on their picnic as the storm begins, and if the 
farmer knows that his crops are failing because of the drouth, 
the purposes held by both will determine what aspects of the 
storm are significant. Probably for both of them the amount 
of rainfall and its duration, rather than its force or its direction, 
would be considered significant and so subjected to measure- 
ment. Measurement then will produce an accurate description 
of these aspects of the storm and all will agree that the amount 
of rainfall is 0.18 of an inch and that the rain lasted thirty-five 
minutes. The evaluation of this amount of rainfall, however, 
will be “good” or “bad” according to the purpose of the judge. 
Even so small an amount as 0.18 of an inch would not be wel- 
comed by the group starting on a picnic. To the farmer, how- 
ever, even 0.18 inches of rainfall is as welcome as if it were 
manna from Heaven. 

An additional illustration may be taken from the field of 
supervision. Practically no one would deny that supervision 
should be measured in part on the basis of changes made in 
children’s growth toward desired educational objectives, when 
proper allowance has been made for growth which results from 
experiences of life inside and outside the school, and not from 
the influence of the supervisor. But different people approach 
the problem of evaluation with different objectives in mind. 
One who puts much stress on the development in pupils of the 
ability to see problems in life situations and the determination 
to solve them, will appraise as of great value supervisory activi- 
ties under which the pupils affected develop these objectives. 
Another, who considers such objectives to be decidedly subor- 
dinate to the objective of securing a high degree of control over 
the tools of reading and ciphering and writing, will appraise the 
same supervisory procedure as of little value, unless they result 
also in a high degree of control over the so-called fundamentals. 

In order to distinguish as clearly as possible between measure- 
ment and evaluation in this statement of criteria, three different 
things are attempted in this chapter. In the first place, in order 
to facilitate comprehensive description of the effects and con- 
comitants of supervision, the criteria are listed. In this list 
they are expressed in so general a form that it is believed that 
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everyone will accept them as being relevant and significant. In 
the second place, in order to facilitate evaluation, these general 
statements of criteria are repeated, accompanied by more specific 
statements which express a certain educational philosophy or 
standard of value. In the third place, the question of weighting 
of the criteria is discussed and suggestions are given as to ways 
and means. 

The list of criteria should serve students of supervision as 
a convenient summary of important bases for describing super- 
vision and its effects. The accompanying examples of standards 
provide an illustration of the way in which the criteria may be 
made concrete to express certain standards of value. No at- 
tempt has been made to use any one system of values. Indeed, 
it should be definitely understood that each individual who en- 
deavors to evaluate supervision must set up his own standards 
of values. The assistance given by this chapter is chiefly in 
outlining the kinds of situations in which the supervision being 
studied should be described and compared with some adopted 
standard. The committee, in presenting certain criteria of 
judgment and in urging individual investigators to formulate 
their own standards of value in each criterion, is thus setting up 
general specifications but leaving the detailed statement to the 
taste and personal preference of the investigator. No other 
action is possible, because individual philosophies do differ, both 
in kind and in degree. 

The general situation is not unlike the evaluation of a house. 
All agree that a house must provide room enough for the occu- 
pants, shelter from sun and wind and storm, adequate light, 
heat, and ventilation, means of ingress and egress, attractive out- 
ward appearance, and so on. Such items are criteria, bases of 
judgment, in each of which the house should be described and 
then compared with the corresponding standard of values adopted 
by the person who makes the evaluation. One possible set of 
standards of values for “attractive outward appearance” may 
include, for example, having the brick of the exterior wall laid 
very regularly and evenly. A possible contrasting set of values 
might include having the brick laid very irregularly and un- 
evenly. Persons holding different sets of values will make dif- 
ferent evaluations of the house as a whole and of its individual 
characteristics. 
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CRITERIA FOR EVALUATION OF SUPERVISION 


Supervision may be evaluated in the light of any one or any 
combination of these three considerations: 


A. Effect. The degree to which its effect upon persons (including pupils, 
parents, teachers, and the community as a whole) and upon educa- 
tional methods and materials approximates the results desired 

B. Activities. The degree to which its activities conform to accepted 
standards for supervisory activities 

C. Supervisor's characteristics. The degree to which the characteristics 
of the person who is doing the supervision conform to the standards 
for such traits 


These three considerations differ greatly in significance. The 
first is clearly of greatest importance, because finally an ac- 
tivity should be appraised only in terms of its effects; the sec- 
ond is of appreciable importance, especially until the first can 
be done completely, because an activity is but once removed 
from its effects; the third is perhaps of some importance, even 
though the personal characteristics lying behind an activity are 
twice removed from the effects that are sought. The relative 
importance of these considerations is independent of the educa- 
tional philosophy of the investigator. 

These considerations may be expressed more fully, as follows: 


That supervision is good, other things being equal or allowed for (these 
other things include pupil capacity to achieve, teacher capacity, all other 
conditions which affect pupil or community progress, and the item of 
cost in time, money, and energy): 

A. Which has desirable and lasting effects? primarily upon pupils and 
community, and secondarily upon teaching materials, teaching 
methods, teachers, principals, and the supervisors themselves, as 
follows: 


1. It increases the amount of progress of pupils toward desired 
educational objectives 

2. It increases the amount of progress of the community toward 
recognized objectives 

3. It increases the amount of progress of teachers toward recog- 
nized objectives 


2In each case the effects referred to are the differences in results over those 
secured by learning and teaching opportunities without aid from supervision. 

*The effects upon pupils and community are considered to be primary, be- 
cause the school’s major aims are to influence the child and society. Teachers, 
principals, supervisors, methods, materials are means to the end of effecting 
changes in pupils and community. 
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4. It increases the amount of progress of principals toward recog- 
nized objectives 
5. It increases the amount of progress of supervisors themselves 
toward recognized objectives 
6. It results in instructional materials that approach more nearly 
the accepted standards 
7. It results in instructional methods that approach more nearly 
the accepted standards 
B. Which consists of activities that are in accord with accepted stand- 
ards of procedure—that is, which are believed to be those most likely 
to produce the results desired as suggested above 
1. The supervisory activities are in accord with the adopted phi- 
losophy of education 
2. The supervisory activities, so far as possible, are based on objec- 
tive evidence secured by the application of scientific method to 
the problem which must be solved 
3. The supervisory activities are conducted in accord with accepted 
principles of efficient administration and management 
4. The supervisory activities are such as are administratively feasi- 
ble, and are relatively economical of time, money, and energy 
C. Which is carried on by persons possessing certain characteristics 
which are accepted as being desirable for supervisory agents—that is, 
which are believed to be those most likely to produce the results 
suggested above 
1. The supervisor has those personal and social characteristics 
which are considered necessary 
2. The supervisor has those professional characteristics which are 
considered necessary 


STATEMENT OF CRITERIA WITH ILLUSTRATIONS 


The foregoing list of criteria is one that is believed to be ac- 
ceptable to all. However, its more detailed interpretation will 
differ from person to person in the same way that the bases of 
their educational thinking differ. In order to show the type of 
expanded statement which must be prepared for each criterion 
by an investigator of the evaluation of supervision, the list of 
criteria is here repeated, together with more detailed expressions 
of what is meant by each criterion. 

That supervision is good, other things being equal or allowed for (these 
other things include pupil capacity to achieve, teacher capacity, all other 


conditions which affect pupil or community progress, and the item of 
cost in time, money, and energy): 


A. Which has desirable and lasting effects, primarily upon pupils and 
community, and secondarily upon teaching materials, teaching 
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methods, teachers, principals, and the supervisors themselves, as 
follows: 
1. It increases the amount of progress of pupils toward desired 
educational objectives, such as 
a. Ability to see problems in life situations and to will to 
solve them 
b. Ability to plan and carry out the solution of these problems 
c. Ability to generalize and transfer the solutions 
d. Ability to codperate effectively with others in the solution 
of problems 
e. Ability to use leisure wisely and well 
f. Control over the most essential tools of continued educa- 
tion 
2. It increases the amount of progress of the community toward 
recognized objectives, such as 
a. Interest in the public schools 
b. Readiness to support them to a reasonable degree 
c. Desire for continued education after formal school days 
are over 
d. Wise use of leisure time 
3. It increases the amount of progress of teachers toward recog- 
nized objectives, such as 


a. Understanding of educational values 

b. Control over teaching method 

c. Discrimination in the use of instructional materials 

d. Ability to recognize and provide for individual differences 
in pupils 

e. Zeal for and consistent effort in personal and professional 
improvement 

f. Readiness to secure assistance from administrative and 


supervisory officers 
g. Ability to recognize and solve instructional problems arising 
in daily classroom service 
4. It increases the amount of progress of principals toward recog- 
nized objectives, such as 
a. Thorough knowledge of the instructional program 
b. Ability to provide proper physical and educational condi- 
tions in order that teachers and pupils may work to best 
advantage 
c. Ability to direct and improve the instructional program in 
their own schools 
d. Ability to appraise conditions within their schools and com- 
munities through the collection of appropriate data, and to 
conduct special studies when necessary 
5. It increases the amount of progress of supervisors themselves 
toward recognized objectives, such as 
a. Thorough knowledge at all times of the status and effec- 
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b. 
¢. 
d. 


e. 


tiveness of the instructional program in the system as a 
whole and in individual schools 

Ability to prepare materials and formulate methods which 
will increase the effectiveness of the teaching process 
Ability to conduct investigations on current instructional 
problems 

Ability to render assistance to teachers in the improvement 
of instruction 

Ability to train principals in the techniques of supervision 


6. It results in instructional materials that approach more nearly 
the accepted standards, such as 


a. 
b. 
c. 
d. 


Selection on the basis of life use 

Adaptation to the needs of individuals 

Proper grade placement 

Final choice of materials on basis of scientific evidence, as 
far as possible 


7. It results in instructional methods that approach more nearly 
the accepted standards, such as 


a. 


b. 
c. 


d. 


Respect for the personality of the pupils 

Recognition of and adjustment to the differences existing 
amog individuals 

Recognition of and adjustment to the differences within each 
individual 

Final choice of methods on basis of scientific evidence, as 
far as possible 


B. Which consists of activities that are in accord with accepted standards 
of procedure—that is, which are believed to be those most likely to 
produce the results desired as suggested above: 


1. The supervisory activities are in accord with the adopted phi- 
losophy of education, such as 


a. 
b. 
c. 


d. 


~ © 


Respect for the personality of both pupils and teachers 
Concern with maximum individual and social growth 
Recognition of broad and comprehensive objectives for edu- 
cation 

Acceptance of the goal of continued growth rather than 
achievement alone 


. Emphasis upon learning rather than teaching 
. Appreciation of the importance of self-activity 
g. 


Recognition of wide variation in individual interests and 
capacities both in teachers and in pupils 


2. The supervisory activities, so far as possible, are based on objec- 
tive evidence secured by the application of scientific method 
to the problem which must be solved 

3. The supervisory activities are conducted in accord with accepted 
principles of efficient administration and management, such as 


a. 


Adoption of and adherence to a constructive plan or pro- 


gram 
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b. Systematic effort to secure wholehearted participation in the 
program by all concerned 

c. Delegation of responsibility and attendant authority 
4. The supervisory activities are such as are administratively feasi- 
ble, and are relatively economical of time, money, and energy 
C. Which is carried on by persons possessing certain characteristics 
which are accepted as being desirable for supervisory agents—that is, 
which are believed to be those most likely to produce the results 

suggested above: 


1. The supervisor has those personal and social characteristics which 
are considered necessary, such as 
a. Energy, enthusiasm, tact, open-mindedness, initiative, per- 
severance, etc. 
2. The supervisor has those professional characteristics which are 
considered necessary, such as 
a. Adequate and varied training, both general and specific 
b. Adequate and varied experience 
c. Interest and codperation in activities of appropriate profes- 
sional organizations 


THE WEIGHTING OF THB CRITERIA 


Evaluation always implies preparation for executive action. 
The presumption is that the procedure which is proved to be 
best will be adopted for more general use. Therefore the 
process of evaluation must conclude with a single summary judg- 
ment—that plan A is better than plan B, or vice versa. No 
matter how many bases of judgment, no matter how many com- 
parisons with standards of value, the final outcome is of neces- 
sity a single composite of the different independent judgments. 

It should be recognized that such a composite judgment in 
every case involves weighting of the elements which make it 
up. This assignment of weights may be made more or less 
informally and even unconsciously, but it is made none the less. 
Since weighting is inevitable wherever more than one criterion 
is employed and wherever the results are to be used in modify- 
ing action, the efforts of educational scientists would be directed 
toward bringing weighting under rational control, toward re- 
placing subjective bases gradually by more objective bases in 
order that the weighting may be done most truthfully. 

As an illustration of the use of weights in ordinary life, con- 
sider the method by which a decision to buy a new house instead 
of continuing to rent is made. The prospective purchaser thinks 
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of as many reasons for and against buying the house as he can. 
Among others he might have in mind the following: 


= 


For (+) 


. Desire to live in one’s own house 
. Opportunity to live in a home- 


owning neighborhood, and allow 
family to associate more with 
people who live in such a neigh- 
borhood 


. Chance to have yard for one’s 


own family, in contrast with 
sharing yard with other family in 
duplex 


. Ability to make minor changes 


in house without feeling that the 
money is wasted because prop- 
erty belongs to another 


. Desire to insure a roof over the 


heads of wife and children in 
case of husband’s sudden death 


. Ability to buy furniture which 


will fit well the space available 


Against (—) 


1. Tendency for a person who buys 


or builds a house to change to 
a@ more costly scale of living, e.g., 
to buy a house which will cost 
perhaps $100 per month to main- 
tain, as compared with the $70 
per month rent paid before 


. Inability to forecast changes in 


population and housing condi- 
tions in area chosen, and conse- 
quent danger of having invest- 
ment in house “turn out badly” 


. Possibility of the person having 


his work changed so that he will 
have to move away and dispose 
of the house at a sacrifice 


. Annoyance from the many little 


bills for repairs and maintenance 
in lieu of one bill for rent 





What actually happens is that the person rates these sev- 
eral points as to importance, or, in other words, weights them 
in terms of their relative appeal to him, and then combines these 
weighted judgments mentally to arrive at his final decision. In 
such a case, the weighting is quite informal and subjective. For 
example, he may rate each reason as very important, important, 
unimportant, as far as he is concerned. Thus: 


Reasons for (+) 


1. Unimportant 
2. Very important 


Reasons against (—) 
1. Very important 
2. Important 


3. Important 3. Unimportant 

4, Very important (very unlikely) 
5. Important 4, Unimportant 

6. Important 


Finally, he considers the question in the light of the reasons 
for and against, and decides in favor of buying a house because 
of the preponderance of “important” and “very important” rea- 
sons for doing so in his case. 

In ordinary life activities no such formal process is used by 
most people in making their decisions on minor matters. Never- 
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theless, the spirit of this procedure is followed in making major 
decisions, even though the form may be neglected. Further, 
what individuals do informally and inadequately in their per- 
sonal problems, organizations—social, political or industrial— 
they do much more systematically and completely in settling the 
larger questions of policy. 

In the evaluation of supervisory activities, a similar procedure 
should be followed if any use is to be made of the results. The 
list of criteria given above suggests the types of things which 
should be measured. If the investigator measures in terms of 
every proposed criterion, he will have thirteen main groups of 
results. These thirteen need to be assigned weights in order to 
have a basis for combination.‘ In addition, the items making up 
the results in any one criterion themselves need to be weighted. 


Bases FOR WEIGHTING 


Two general bases for weighting are proposed. The first is 
importance, which is determined by one’s philosophy. Items 
are deemed important by us to the degree that we believe that 
they contribute to what we consider to be the ultimate good. 
Other things being equal, the criteria should be weighted di- 
rectly in proportion to their relative significance as judged by 
the investigator. Thus, the committee’s judgment, stated above, 
was that the effect of supervision is a more important criterion 
than are the supervisory activities themselves, and that these in 
turn are more important than the characteristics of the super- 
visory agent. Similarly, the effects upon pupils and community 
were adjudged to be primary and those upon teachers, princi- 
pals, supervisors, methods, and materials were adjudged to be 
secondary in importance. Others may not agree with these 
particular rankings as to importance, but they are obligated to 
adopt some weighting as to importance. 

The second basis for weighting includes the validity and re- 
liability of the evidence which has been secured with reference 
to each criterion. Other things being equal, the criteria should 
be weighted directly in proportion to the relative reliability and 
validity of the data obtainable. If it is not possible to secure 


*Care should be taken to avoid a common misconception about weighting, 
which is that there is no weighting if the elements are considered of equal 
value. It is clear, of course, that such a case merely constitutes the simplest 
case of weighting, where each item is assigned a weight of 1. 
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reliable and valid measurements in a certain field, the weight for 
that field should be decreased. For example, everyone who has 
worked with the evaluation of supervision realizes how difficult 
it is to secure adequate and accurate measures of effect upon the 
community and the necessity of ascribing only a low weight to 
this criterion. 

It is evident that these two bases of weighting—importance, 
and validity and reliability of the evidence—must themselves be 
weighted in combining them to decide on weights for the criteria. 
Some will consider the philosophical basis of importance to be 
more significant than the basis of the character of the measure- 
ment possible; others will reverse the emphasis. 


EXPRESSION OF WEIGHTS 


Some readers of this yearbook may raise the question of the 
way in which the weights should be expressed in an actual in- 
stance of evaluation. Several suggestions may be made. The 
evidence for and against may be arrayed as in the instance of 
buying versus renting a house and the different items be ranked 
as to importance by the use of phrases such as “very important” 
and “of no importance.” 

Another convenient form of final expression of the weights 
for a particular investigation is the distribution of 100 points 
among the criteria considered. This is not unlike the procedure 
followed in the preparation of score cards.® 

Although the committee is not recommending any specific plan 
of weighting for the criteria presented in this chapter, it does 
urge, however, that cognizance be taken generally of the need 
for the use of weights for the different criteria which serve as a 
basis for the evaluation of supervisory activities. Whether ex- 
pressed numerically or not, the relative weights given to the 
various items of the data in reaching a final decision concern- 
ing the point at issue should always be reported.® 


*Strayer, George D., “Score Card for City School Buildings.” Fifteenth 
Yearbook, National Society for the Study of Education, Part I (1916), Chap. 
III, 41-51. 

Engelhardt, N. L., Evenden, B. 8., and Hart, F. W., “Measuring City Church 
and Religious Education Plants.” Walter S. Athearn’s The Indiana Survey of 
Religious Education, Part II. New York: George H. Doran and Company, 1924. 

*It has been taken for granted throughout the discussion that results are 
expressed in commensurate and comparable form. 
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CHAPTER III 
PROCEDURES IN THE EVALUATION OF SUPERVISION 


This chapter is intended to present a general discussion of the 
ways and means for gathering evidence as to the value of super- 
vision. It will suggest a classification of these ways and means, 
and will describe each briefly. Its value to supervisors and 
others interested in measurement and evaluation of the work of 
supervisors lies in the suggestions it may offer toward the plan- 
ning of more careful and more conclusive investigations in the 
evaluation of supervisory activities. 


DIFFICULTIES OF EVALUATION 


The evaluation of supervision is not easy. Indeed, the meas- 
urement of the effects of supervision, even without evaluation, 
is not easy. As was pointed out in the preceding chapter, evalu- 
ation adds to measurement the comparison with some standard 
adopted by the person making the evaluation and the weighting 
of several such comparisons, on the basis of which final judg- 
ment as to value may be reached. Obviously this process adds 
new difficulties. 

Measurement and evaluation have not been accomplished 
satisfactorily even with reference to the basic question, “Is super- 
vision better than no supervision?” A still less satisfactory 
answer has been given to the problem of measurement and 
evaluation with reference to the question, “What type or plan 
of supervision is most effective?” Both of these questions— 
supervision versus no supervision, and supervisory plan A versus 
supervisory plan B—need to be answered in order to have a com- 
plete evaluation of supervisory activities. 

Supervision is more difficult to measure and evaluate than 
teaching because of the fact that it is one step further removed 
from the effects with which this yearbook is most concerned. 
Teaching is essentially a process of making changes in children, 
and the measurement of its effectiveness requires only the 
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measurement of resultant changes in children. Supervision, on 
the contrary, operates to change teachers and through them to 
change the children. Measurement of its effectiveness is com- 
plicated by the fact that there are many other influences play- 
ing upon both the teacher and the children. 

Nevertheless, there have been a fairly large number of at- 
tempts made to appraise supervision in general and certain su- 
pervisory procedures in particular. The first efforts were frankly 
speculative in character. Proponents of supervision argued in 
its favor with the aid of such opinions as occurred to them; 
opponents of supervision sought and expressed arguments about 
its ineffectiveness, cost, and general undesirability. 

Even these early efforts at appraisal had some basis in fact 
for the opinions uttered. Later students of the problem en- 
deavored to gather and use the relevant facts much more com- 
pletely. Data were collected on the number of children who 
were promoted under a given supervisory régime, or on the num- 
ber of teachers who read certain books or took certain courses. 
At this stage, however, the emphasis was chiefly on the collec- 
tion of facts and only secondarily on their interpretation. 

At present those who are seeking to evaluate supervision are 
not only addressing themselves to the problem of collecting facts 
on the effectiveness of supervision in general or of some par- 
ticular plan of supervision, but they are also attempting to plan 
their work so as to have comparative facts of various sorts 
which will make possible a better interpretation of their origi- 
nal data. To phrase it in terms of the language of scientific 
method, an increasing effort is being made to measure the effect 
of one variable by controlling the other variables or making 
allowance for them. 


COLLECTION VERSUS INTERPRETATION OF DaTA 


It is through provision for better interpretation of data that 
the greatest progress has been and is being made in educational 
experimentation. It is true that more appropriate, more re- 
liable, and more comprehensive data are being secured every 
year; but even greater progress is being made in devising ways 
and means of conducting investigations and organizing results 


1See Chapters IV, V, VI, VII of this yearbook for a more detailed account 
of these attempts and a report of the conclusions reached. 
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so that the truest possible interpretation can be made. Progress 
in this direction has come chiefly from greater utilization of the 
principles of scientific method. 


THE GENERAL SCIENTIFIC MretHop 


The fundamentals of the procedures to be used in discovering 
truth in educational matters are believed to be the same as 
those for discovering truth in any other field of human interest. 
It therefore seems appropriate at this point to state the charac- 
teristics of the general scientific method. Curtis has expressed 
them as the attitudes which the scientific worker must have.” 


Tue Scientiric ATTITUDES 


I. Conviction of universal basic cause and effect relations, rendering 
untenable 
1. Superstitious beliefs in general, as “signs” of “good or bad luck,” 
and charms 

2. “Unexplainable mysteries” 

3. “Beats all” attitude, commonly revealed by 
(a) Too ready credulity 
(b) Tendency to magnify the importance of coincidence 


II. Sensitive curiosity concerning reasons for happenings, coupled with 
ideals 
1. Of careful and accurate observations, or of equally careful and 
accurate use of pertinent data previously collected by others 
2. Of patient collecting of data 
3. Of persistence in the search for adequate explanation 


III. Habit of delayed response, holding views tentatively for suitable 
reflection varying with the matter in hand 
1. To permit adequate consideration of possible options 
2. To permit a conscious plan of attack, clearly looking forward to 
a prediction of the probable outcome or solution 
IV. Habit of weighing evidence with respect to its 
1. Pertinence 
2. Soundness 
3. Adequacy 


V. Respect for another’s point of view, an open-mindedness, and will- 
ingness to be convinced by evidence 


Pearson has expressed the characteristics of the scientific 
method somewhat differently, as follows: “The classification of 


2Curtis, F. D., “A Determination of the Scientific Attitudes.” Journal of 
Chemical Education, I1I (August, 1926), p. 927. 








26 THE EVALUATION OF SUPERVISION 


facts, the recognition of their sequence and relative significance 
is the function of science, and the habit of forming a judgment 
upon those facts, unbiased by personal feeling, is character- 
istic of what may be termed the scientific frame of mind.” * 

It may not yet be feasible in all educational situations to 
apply strictly the tenets of the scientific method. Educational 
investigations probably cannot be as accurate and precise as 
studies in the physical sciences. Nevertheless, the tendency is 
clearly toward a more general adoption of the scientific method 
in educational work. 


Pure Versus APPLIED SCIENCE 


For purposes of discussion a distinction should be made be- 
tween pure science and applied science or between pure research 
and applied research. Charters‘ makes the distinction that 
pure research may be applied to any problem whatsoever if ‘it 
be attacked by scholarly methods, whereas practical research is 
concerned only with problems met with in practical life, and 
the results obtained from it must operate to some extent in im- 
proving practice. 

The essential difference between pure and applied science is 
believed to lie in the purposes to be achieved by each. Pure 
science is the quest for relationship, usually to be expressed as 
a law. Pure science makes progress when many facts which are 
apparently more or less independent are resumed in a single sum- 
mary statement expressing the relationship existing among them. 
Pure science achieves its goal when it is able to subsume sev- 
eral such generalizations under a single, more inclusive, and 
more general one. 

“The progress of [pure] science lies in the continual discover- 
ing of more and more comprehensive formule, by aid of which 
we can classify the relationships and sequences of more and more 
extensive groups of phenomena.” * 

Applied science on the other hand is the quest for the better 
of two methods or two materials. It involves the comparison 
of two or more alternative ways of attaining a desired goal. 


* Pearson, Karl, The Grammar of Science, Third Edition. London: Adam and 
Charles Black (1911), p. 6. 

*Charters, W. W., “Pure Research and Practical Research.” Journal of 
Educational Research, XII (September, 1925), 95-101. 

5 Pearson, Karl, op. cit., p. 96. 
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Applied science achieves its purpose when the better way, all 
things considered, is discovered. 

Obviously the worker in pure science may secure by-products 
which are like the products of applied science as here defined. 
More frequently he gets suggestions and leads for applied sci- 
entific investigations. Indeed, in the minds of the directors of 
great industrial corporations like the General Electric Com- 
pany or the American Telephone and Telegraph Company, 
which maintain strong research laboratories, the final justifica- 
tion for pure research lies in the occasionally secured by- 
products of improved methods and materials. 

In like manner, applied science often overlaps pure science. 
The history of science is full of illustrations of men who have 
made major scientific discoveries while working intensively on 
some practical problem in applied science. 


Tue EVALUATION OF SUPERVISION 


The evaluation of supervision is a clear case of applied science. 
The question to be answered is, “Which is the better of two 
proposed plans involving supervision?” It may be that we are 
interested in the value of supervision as contrasted with the 
value of no supervision. Or, we may be concerned with the 
value of some particular supervisory organization or plan as 
contrasted with the value of some other supervisory organiza- 
tion or plan. In either case the purpose is to compare the 
values obtained from two different procedures. 


Cuter PHasges IN EvALUATION 
The major phases in evaluating supervisory activities are: ° 


1. Definition and delimitation of the problem 

2. Choice and weighting of the criteria or bases of judgment, 
and provision for measurement 

3. Control of all significant factors except the one supervisory 
factor whose effect is to be measured 

4. Organization and interpretation of the results 


*The classic analysis of steps is that given in Dewey, John, How We Think. 
New York: D. C. Heath (1910), p. 72. For a more detailed account of the 
steps in an educational investigation, see: Rankin, Paul T., “Survey Techniques 
for the Experimental Determination of the Value of Materials and Methods.” 
Scientific Methods in Supervision, Second Yearbook, National Conference of 
Supervisors and Directors of Instruction (1929), Chap. XVII. 
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All four of these phases should be carried out in accordance 
with the tenets of general scientific method. 


DEFINITION AND DELIMITATION OF THE PROBLEM 


The first step essential to any program of evaluation of 
supervision is to determine the specific question which the investi- 
gation is expected to answer. Care should be taken to define 
this problem as specifically as possible and to indicate clearly 
the point at which the particular problem under considera- 
tion ends. Too frequently an effort to evaluate supervision 
fails by reason of the fact that the problem is not expressed 
with sufficient precision and adequate detail. At the same time 
it is incumbent upon the investigator to guard against so great 
detail in the expression of the problem that the relations of 
the details to the whole are lost. The effective investigator 
must steer between the Scylla of so general an expression of the 
problem that nothing can be discovered, and the Charybdis of 
so detailed a statement that freedom to vary during the in- 
vestigation is inhibited. 


THE CHOICE OF THE CRITERIA FOR JUDGMENT 


The question of criteria, as far as it has reference to the 
evaluation of supervision, has been discussed rather fully in 
Chapter II of this yearbook. Since the conclusions from the 
investigation are determined in large degree by the criteria 
used, it is very important that they be significant, comprehen- 
sive, and properly weighted. 

In addition to the choice of criteria there needs to be a pro- 
gram of measurement which will insure the collection of data 
on each of the major criteria adopted. Such a program of 
measurement is interpreted to mean the plan of securing descrip- 
tions of changes in the various criteria. For example, one cri- 
terion may be the attitude of the community toward its schools. 
The measurement program might then include a plan for as- 
sembling records of the votes on school bonding issues, of the 
number of parents sending children to private schools, of the 
results of a questionnaire to selected parents, and so forth. 
Obviously, records from such a program should be secured at 
least twice in any investigation in order to be able to evaluate 
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the changes in the criterion elements which occur as a result 
of the experimental plan being observed. 


CoNTROL OF ALL SIGNIFICANT VARIABLES EXCEPT THE ONE 
SuPERVISORY VARIABLE WHOSE EFFECT IS BEING MEASURED 


The investigator of the value of supervision needs to remember 
that conclusions which are to be based presumably on the opera- 
tion of one variable, such as a variation in supervisory activities, 
must be proved to be due to the operation of that variable alone. 
Every other factor which can influence the criteria must be 
controlled or allowed for. 

The control of other variables is in all probability the most 
vexing problem in the evaluation of supervision. In Chapter 
II, the criteria of value of supervision were expressed as being 
primarily the effects upon pupils, teachers, principals, super- 
visors, community, methods, and materials. Unfortunately su- 
pervision is not the only factor which is bringing about change 
in these seven items. For example, in the case of changes in 
children, there are a host of other factors which are influential; 
and it is exceedingly difficult to isolate the effects of any single 
one, such as supervision. 

Attention should be called to the fact that two kinds of con- 
trol of other significant factors are possible. One of these is 
usually expressed as “holding other factors constant.” An ex- 
ample of this type of control in the evaluation of supervision 
would be to make the factor of pupil intelligence substantially 
the same in the group of children involved in supervisory plan 
A as it is in the group of children involved in supervisory plan 
B. In practice this is ordinarily done by choosing the children 
so that the proportion in the different levels according to intelli- 
gence quotient or mental age is the same in the two groups. 
The other type of control of these is usually expressed as 
“allowing for the operation of other factors.” This procedure is 
necessary with factors which can not be equated by the experi- 
menter. In such situations the operation of these factors must 
be measured as accurately as possible and allowance made for 
their effects on the criterion items. An example of this type in 
the evaluation of supervision would be the appraisal of super- 
visory activities affecting two different groups, such as Grades 
VII and VIII, which plainly could not be made equivalent 
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in training and school level. In such a case the investiga- 
tion might be carried through and then the changes made in the 
pupils in the two different plans might be adjusted in order to 
make allowance for the differences to be expected in the results 
attained by children in Grades VII and VIII. In point of fact 
this process of allowing for other factors is likely to be unsound 
because of the limitations of present knowledge as to their ef- 
fect. It is much better experimental procedure to control these 
factors wherever possible and render them the same for the 
several groups involved in the experiment. 

One major question for the experimenter in this connection 
involves the decision as to what these other factors are which 
he must endeavor to control or allow for. It is here that many 
investigations have been weak. Perhaps the only general an- 
swer that can be made to the question is that all factors, of what- 
ever type, which have a demonstrable relationship with the items 
chosen as the criteria of judgment should be included. Pupil 
progress as measured by standard educational tests is used so 
frequently as a criterion in educational experiments that refer- 
ence should be made to some of the studies of the relationship 
between pupil achievement and certain factors which are be- 
lieved to be contributory.’ 

It is important to take care that no truly significant factor 
is omitted. It is also important to see that no factor of negligible 
importance in affecting pupil growth is included, since its inclu- 
sion adds nothing to the experimental control desired, and only 
increases the complexity and difficulty of the procedure. 


THE ORGANIZATION AND INTERPRETATION OF THE RESULTS 


The organization of the data is the arrangement of informa- 
tion which has been collected in form to facilitate the drawing 


™W. G. Bergman, in University of Michigan, School of Education Bulletin for 
March, 1930, page 94, reports investigation of some 14,000 cases in which 
he shows that the correlation between achievement on standard educational 
tests and other factors is appreciable only in the following items: chronological 
age, school grade, and intelligence. The other items which many people have 
believed to have a decided bearing on pupil achievement but which Bergman’s 
experiment did not substantiate are as follows: sex, socio-economic status of 
pupils, size of the community, training of the teacher, experience of the teacher. 
Similarly, Katherine M. Densworth, in the Twenty-seventh Yearbook of the 
National Society for the Study of Education, Part II, page 87, points out that 
“differences in amount of schooling of pupils of a single age do not account for 
their mental or educational development.” 
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of conclusions. In many cases the data will be expressed numeri- 
cally and this stage of organization will utilize largely the statis- 
tical method. 

Control over the standard methods of statistical analysis 
is part of the stock in trade of the skilled worker who attempts 
to evaluate supervision.’ The truly competent investigator, how- 
ever, goes further than this. He realizes that, just as present 
standard methods have supplanted earlier procedures, so the 
current procedures may be expected to change or be replaced 
by still better ones. Accordingly, he endeavors to be critical of 
existing statistical processes, and to be open-minded about pro- 
posed modifications.® 

The form of organization of the results usually culminates 
in a measure of the differences between plan A and plan B with 
respect to the criterion adopted. For example, if the investiga- 
tion were to compare the effectiveness of vertical and horizon- 
tal organization of supervision, the results in the final arrange- 
ment would appear as the difference between the effects of the 
horizontal organization and the effects of the vertical organiza- 
tion. The problem then is the interpretation of this difference. 

Two general types of questions should always be asked in 
interpreting difference. The first is, “Is the difference reliable?” 
In other words, are these data representative of what the re- 
sults would be if the investigation were repeated under identical 
conditions a number of times? Statistically, this question re- 
solves itself into that of the statistical reliability of the difference 
discovered. Rather generally accepted standards for the degree 
of reliability possessed by a difference in any particular instance 
are available for use by any investigator..° These standards 
make it possible for a person to know whether or not the re- 
sults which he secures might have been secured by chance or 


whether they really mean what they appear to mean." 

® See such books as: Garrett, Henry E., Statistics in Psychology and Educa- 
tion. New York: Longmans, Green and Co., 1926. 

Holzinger, Karl J., Statistical Methods for Students in Education. Univer- 
sity of Chicago Press, 1925. 

*°Courtis, S. A., “Maturation Units for the Measurement of Growth,’ School 
and Society, XXX (November, 1929), 683-690. 

“Garrett, Henry E., Statistics in Psychology and Education, pp. 128-137. 
New York: Longmans, Green and Co., 1926. 

4 For a more complete explanation of the statistical interpretation of a dif- 
ference, see Monroe, W. S., and Engelhart, M. D., “Experimental Research in 
Education.” Bureau of Educational Research Bulletin, No. 48. Urbana: College 
of Education, University of Illinois, 1930. 
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The other question is, “How meaningful is the difference?” 
In other words, granting that the difference is a real one as far 
as reliability goes, is it large enough to mean anything in prac- 
tice? 

Unfortunately there is no form of expression for the dif- 
ference from the point of view of magnitude or meaning which 
is as generally accepted as are the statistical procedures for ex- 
pressing the reliability of the difference. It is often expressed 
in terms of some measure of dispersion of the original data, 
such as the standard deviation or the probable error. Either of 
these forms may be converted in turn into the percentage of 
cases under one plan which have a higher mean gain than under 
the other plan. Another medium of expression is the ratio of 
the difference to the average change made between adjacent 
grades or adjacent ages in the traits under consideration. For 
maximum value to the investigator there should be available 
quite a variety of interpretations as to meaning.’? 

In all of these phases of scientific procedure as applied to the 
evaluation of supervision, it will be found helpful to consider 
the suggestions which have been formulated by many writers 
on general scientific method,'* and by a number of writers on 
scientific method in the field of education.’ 


PARTICULAR PLANS 


The investigations that have been made in the effort to evalu- 
ate supervision may be classified broadly into those based on 
the collection of opinion and those based on the collection of 


%2For examples of several devices for interpretation of a difference, see: 
“Effectiveness of Half Time Sessions,” Detroit Educational Research Bulletin, 
No. 11 (February, 1926), 24-30. 

18 Schluter, W. C., How to Do Research Work. New York: Prentice-Hall, 1926. 

Columbia Associates in Philosophy, An Introduction to Reflective Thinking. 
Boston: Houghton Mifflin, 1923. 

4 Bixler, H. H., Check Lists for Educational Research. New York: Bureau 
of Publications, Teachers College, Columbia University, 1928. 

Crawford, C. C., The Technique of Research in Education. Los Angeles: 
The University of Southern California, 1928. 

Good, Carter V., How to Do Research in Education. Baltimore: Warwick and 
York, 1928. 

Lundberg, George A., Social Research. New York: Longmans, Green and Co., 
1929. 

Monroe, W. S., and Engelhart, M. D., “Experimental Research in Education,” 
Bureau of Educational Research Bulletin, No. 48. Urbana: College of Educa- 
tion, University of Illinois, 1930. 
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facts relative to the fundamental criteria. They may be further 
subdivided as follows: 


A. Collection of opinion, through the use of 
1. Interview 
2. Questionnaire 
3. Jury 


B. Collection of facts, through the use of 
1. Observation (case study) 
2. Experiment 
(a) One group 
(b) Equivalent groups 
(c) Rotated groups 


It is patent that investigations utilizing the method of col- 
lection of opinion in one form or another, however well they may 
be conducted, can never be as conclusive as well-conducted in- 
vestigations which are based on the collection of factual data. 
Nevertheless, each type of investigation here mentioned has had 
its place and has been helpful in the general problem of the 
evaluation of supervision. As better control is secured over 
methods of measuring the critical elements of a situation and of 
controlling all factors save the one whose effect is being studied, 
investigations based on opinion will be replaced by investiga- 
tions based on more truly factual data. 


Tue COLLECTION OF OPINION 1° 


The Interview. The interview as a method for the evalua- 
tion of supervision consists essentially in having the investigator 
formulate questions for securing data to be used as the bases of 
judgment in that particular investigation. Following the se- 
lection of the questions, the individuals who are best fitted by 
experience and training for giving the desired information are 
chosen. The investigator then interviews personally these indi- 
viduals, records their responses, brings together the resulting 
data in systematic form, and draws his conclusions from 
them. 

18 Lundberg, G. A., Social Research. New York: Longmans, Green and Co., 
a E. 8S., The New Social Research. Los Angeles: Jessie Ray Miller, 
1926. 


Ogg, F. A., Research in the Humanistic and Social Sciences. New York: 
Century Co., 1928. 
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The Questionnaire. This method is like the interview method 
in essential characteristics except that the questions are asked in 
written form. In the case of the questionnaire, however, there 
is usually no possibility for the investigator to get additional 
information or to get the respondent’s particular point of view 
and understanding of certain questions. The procedure in gen- 
eral is to draw up a questionnaire in considerable detail and sub- 
mit it to a selected list of persons who are believed to be in 
possession of the desired information. This method has been 
used very extensively in educational work during recent years 
and many improvements have been made in the questionnaires 
used. So important has the questionnaire become that the Re- 
search Division of the National Education Association has made 
an elaborate investigation of questionnaires and their use.’® 


The Jury Method. The term “jury” has been used with some- 
what different meanings in various educational investigations 
where expert opinion was to be collected. Usually the term re- 
fers to the securing of a single composite judgment from a group 
of judges on a number of questions which may be presented either 
in interview or in questionnaire form. The studies reported in 
Chapter IV on pages 48 and 49 are instances of this usage of 
the word “jury.” Another sense in which the word is used is 
simply as a collection of judgments secured from people to 
whom a questionnaire has been addressed and who are presum- 
ably competent in a particular field. 


CoMMENTS ON OPINION METHODS 


All three of these procedures based on opinion have substan- 
tially the same advantages and are open to the same objections. 
The primary advantage is that opinions of people may be gath- 
ered in many situations in which it is practically impossible at 
the present time to secure genuine factual material. A second 
advantage of these methods is the likelihood of receiving addi- 
tional materials not contemplated by the investigator but which 
do add materially to the basis for final judgment in the situa- 
tion. The questionnaire usually, and the interview almost al- 
ways, allows and even stimulates the presentation of ideas which 


16“The Questionnaire,” Research Bulletin of the National Education Associa- 
tion, VIII, No. 1 (January, 1930). 

Koos, L. V., The Questionnaire in Education, A Critique and Manual. New 
York: Macmillan Co., 1928. 
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are called out by the questions but which are only indirectly 
related to them. 

These three methods for the collection of opinion have as a 
fundamental objection the difficulty that the summary of the 
results secured is, in the last analysis, only a summary of opinion 
about facts rather than a summary of the facts themselves. In 
many cases in which it has been possible to check opinion by 
independently ascertained facts, it has been found that both the 
opinion expressed by an individual and the composite opinion 
expressed by a group very frequently depart far from the truth 
as revealed by a collection of the facts. Another disadvantage 
usually present when the methods of opinion are used is the 
fact that, on the one hand, the person responding does not al- 
ways know just what is wanted of him and consequently fails to 
give all the relevant information he has; and, on the other hand, 
the person who studies and organizes the replies very often does 
not read into each reply just what was intended by the re- 
spondent. Difficulties like these latter, however, can be mini- 
mized greatly if sufficient care is taken in planning the question 
and in analyzing the replies. 

In connection with the methods of opinion, one special use to 
which they may be put needs to be mentioned. This is the 
situation in which the so-called methods of opinion are true 
fact-finding methods. If the experimenter’s purpose is to dis- 
cover the current status of opinion on certain points, it is 
obvious that he must use one of the methods of opinion. In 
such a case the results which he secures are facts in terms of 
his purpose. 


THE COLLECTION or Facts 


The two contrasting methods for the collection of facts which 
are usually recognized are observation and experiment. They 
are alike in that they both assume the observation of occur- 
rences and their collection in a systematic form in order to per- 
ceive relations and to make comparisons. They are unlike in the 
amount of control of conditions that is exercised by the investi- 
gator. In observation the investigator takes the situation as it 
is, observes what occurs, records it, and arrives at his conclu- 
sions after making allowances as best he can for the changes 
which have occurred in the conditions during the progress of 
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the investigation. In experimentation the investigator sets up 
the conditions under which he will observe and reproduces them 
at will within the limits of practicality. By this means he is 
able to control, in some degree at least, the factors which are 
operating during the time of his investigation. In the history 
of science, observation has usually preceded experiment. The 
latter, however, is considered to be the basic type of investiga- 
tion for yielding truly conclusive results. Of course, observation 
is the only method possible in fields like astronomy where hu- 
man beings are unable to control the significant conditions. In 
most educational work, however, it is possible to provide within 
limits the conditions for experimentation as well as for observa- 
tion. 


Observation. The outstanding type of investigation which in- 
volves observation alone and which is applicable to the evalua- 
tion of supervision is the case study. The essential elements 
of case study are the adoption of a problem,’’ the selection of 
one or more cases in which the problem situation is operating, 
the observation and recording in great detail of all the occur- 
rences believed to be significant in the situation during the 
time observed, and the interpretation of the facts gathered. 
Chapters VI and VIII of this yearbook present illustrations of 
the case study method as applied to the evaluation of super- 
vision. 

Experiment. McCall’s frequently quoted classification of ex- 
periments in education is the best for the purpose under consid- 
eration here.’® He classifies experiments as one-group, equiva- 
lent-group, and rotated-group. The essence of the one-group 
plan is that a record of one situation is made, the experimental 
factor is applied to it, and then a second.record is made. The 
change from the first to the second record is considered to be a 
measure of the effect of the application of the experimental 
factor. 

The equivalent-group method is essentially a plan of having 
two different situations alike in all essential regards except the 
one whose effect is being measured. Records are made of both 

Lundberg, G. A., Social Research, Chap. VIII. New York: Longmans, 
Green and Co., 1929. 


% McCall, W. A., How to Experiment in Education, Chap. Il. New York: 
Macmillan Co., 1923. 
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situations at the beginning and at the close of the period of ob- 
servation. The difference in the amount of change is taken as 


-being a measure of the effect of the experimental factor. 


The rotated-group, or alternating-group, plan is essentially 
a combination of the one-group and the equivalent-group 
methods. In this plan, during the first period, situation A op- 
erates under experimental factor one and situation B under 
experimental factor two; the experimental factors are then in- 
terchanged, and during a second and equal period situation A 
operates under experimental factor two and situation B operates 
under experimental factor one. Measurements are made at the 
beginning, at the change, and at the end of the entire observation 
period. The difference in the average amounts of change under 
the two different factors is taken as a measure of their compara- 
tive effects. 

Both the equivalent-group and the rotated-group methods may 
be used with more than two variations in the experimental fac- 
tor. Obviously, when there are more than two variations, more 
than two experimental groups need to be used. McCall gives in 
considerable detail the experimental set-up for different num- 
bers of factors and for different numbers of tests. 


CoMMENTS ON THE Fact MeEtTHops 


As has been pointed out many times, the outstanding advan- 
tage of methods of fact over methods of opinion is the greater 
truthfulness and consequently greater usefulness of the results. 
Except for those cases where the problem is to discover consensus 
on some matter, the methods of opinion can never be expected to 
lead to more than suggestive findings, whereas the methods of 
fact when properly and adequately conducted may yield con- 
clusive findings. Again, as between the procedure of observation 
and the procedure of experimentation, the advantage in certainty 
of conclusions lies with experimentation. The reason is that 
observation is primarily a source of hypotheses and experimenta- 
tion is a means of testing hypotheses. 

It is difficult in brief compass to discuss the relative merits of 
the three types of experimental investigations. Reference may 
better be made to McCall’s discussion of the subject.’® Suffice 


% McCall, W. A., How to Experiment in Education. New York: Macmillan 
Co., 1923. 
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it to say here that, in general, the equivalent-group method is 
the one that seems to be best adapted for scientific work in the 
evaluation of supervision. 


Tue Kinps or INVESTIGATIONS NEEDED 


Succeeding chapters of this yearbook will review in some de- 
tail the particular methods and findings of the studies made 
thus far in the evaluation of supervision. Many of them—in 
fact, almost all—have been devoted to an attempt to find out 
what somebody thought about supervision. Studies of teachers’ 
opinions of supervisory service predominate. Studies that in- 
volve, on the basis of objective measurement of the criteria, the 
comparison of supervision with no supervision, or that compare 
one plan of using a certain supervisory device with another, are 
decidedly in the minority. Yet their number is growing and 
may be expected to continue to grow. Only through careful ex- 
periments, refined and repeated again and again, can certain 
knowledge of the value of supervision be secured. 



































CHAPTER IV 


ILLUSTRATIONS OF TECHNIQUES USED IN THE 
EVALUATION OF SUPERVISION 


In a recent formulation of a philosophy of educational super- 
vision Kyte has stated that “the activities of supervision which 
contribute toward” the “maximum development of the teacher 
into the most professionally efficient person she is capable of be- 
coming at all times” include, among others, 


Careful study and thorough evaluation of all supervisory means so that 
the most effective and the most economic procedures may be followed 
in helping teachers to grow in their expertness. . . . 

Careful appraisal of the supervisory activities to insure the growth of 
the supervisory staff corresponding to the growth of the teachers, thus 
leading to increasingly efficient guidance of teachers in their efforts to 
progress.” , 


Elsewhere in the same book are to be found also the state- 
ments: 


Before a plan of supervision can be considered as complete, the super- 
visor must analyze and appraise himself... . In a highly professionalized 
school system it is often possible to obtain valuable constructive help 
from superiors, colleagues, and assistants in obtaining a better objective 
impersonal self-appraisal than in attempting to make it entirely alone? 


The above quotations indicate the three kinds of evaluation of 
supervision which have been undertaken during the last few 
decades. The implications involved in them can be restated in 
the form of three questions, as follows: 

1. What valuable contributions to the growth of children are 
due to supervision? 

2. What significant educational influences on teachers and 
their professional growth are due to the personality and help of 
each supervisory officer? 

1 Kyte, G. C., How to Supervise, pp. 45-46. Boston: Houghton Mifflin, 1930. 

2 Ibid., p. 127. 
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3. What significant contributions to supervisory efficiency are 
due to each of the various types of supervisory activity? 

The present chapter has been written for the purpose of pre- 
senting to the reader not what answers have been obtained to 
these questions but primarily how the answers have been derived. 
The numerous published studies cited in this report have been 
written with the emphasis largely on the findings. Previous sum- 
maries of some or all of the studies have also stressed the out- 
comes reported in or implied from the studies. These valuable 
contributions to knowledge in this specialized field are treated 
only in a limited way at this time, therefore, in order to make 
possible a more extensive presentation of the various research 
techniques, especially, which have been developed or adapted and 
used to date in the numerous endeavors to obtain pertinent an- 
swers to the above questions. The considerable amount of litera- 
ture in this very delimited field of research also necessitates such 
a limitation of the presentation in order to insure adequate 
treatment of the nature of the many techniques of appraisal 
which have been developed and applied. 

An intensive search of the educational literature discloses that 
the application of research to appraisal in supervision is of re- 
cent origin. In fact, a volume by Rice published in 1913 con- 
tained the statement that, “The fundamental condition of suc- 
cessful supervision has not yet come into being; for standards in 
educational achievement are as yet absolutely unknown.” ® 

Some beginnings had been made before that date, however, 
but the large number of investigations and most of the published 
literature belong to the last decade. In fact, the rapidly increas- 
ing number of reported studies in the last few years indicates 
that educational workers are in the midst of an era in which the 
evaluation of supervision, and especially of supervisory tech- 
niques, is being carried on both extensively and intensively. 

Chapters IV and V are based on studies published in cur- 
rent professional literature and on unpublished studies reported 
by the membership of this Department in which the variable 
under consideration is some aspect of supervision. 

The investigations illustrate how almost all of the types of 
research procedures discussed in Chapter III have been utilized 


? Rice, J. M., Scientific Management in Supervision, p. 267. New York: Noble 
and Noble, 1913. (Used by permission of copyright owners.) 
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to obtain appraisals. Chapter IV contains summaries of the 
investigations in which have been stressed the use of (1) the 
questionnaire, (2) the jury, (3) the interview, and (4) the case 
study; Chapter V, studies involving primarily (5) an experi- 
mental group, (6) equivalent groups, (7) score card, and (8) 
comprehensive investigation. 


QUESTIONNAIRES TO TEACHERS FOR GENERAL APPRAISAL 
OF SUPERVISORS 


Since the influence of personalities was inevitably the first 
aspect of supervisory activities to become markedly felt in school 
systems employing supervisors, the first attempts at appraisal 
consequently centered around this phase. Quite naturally, per- 
sons in various school systems began inquiring regarding the re- 
actions of teachers to supervision and supervisors. As early as 
1897, Brooks‘ reported the reaction of teachers to supervision, 
merely generalizing her presentation of conclusions reached 
through analysis of accumulated data. 

About twenty years later, Bird® sought “to discover some of 
the qualities of supervisors most appreciated by teachers” by 
obtaining the reactions of teachers of experience enrolled in va- 
rious college classes. The data secured were tabulated and per- 
centages of frequency of occurrence of items computed. From 
one group of teachers an order of merit rating was also 
obtained regarding the points mentioned by the other groups of 
teachers. 

Bell,* Nutt,” and Saunders ® carried on similar studies but ob- 
tained their data directly from teachers in service. The first 
two presented their data in frequency distributions, but Saun- 
ders discussed her findings without presenting specific data. The 
three investigators departed from the approach made by Bird, 
including the reactions of teachers to specific supervisory helps 

* Brooks, Sarah, “Supervision as Viewed by the Supervised,’ National Educa- 
tion Association Proceedings, 1897, pp. 225-232. 

5 Bird, G. E., “Teachers’ Estimates of Supervisors,” School and Society, V 
(June 16, 1917), 717-720. 

*Bell, A. D., “Grade Principal as Seen from the Teacher’s Desk.” Popular 
Education, XLII (September, 1924), 12-13. 

tNutt, H. W., “The Attitude of Teachers Toward Supervision.” Ohio State 
University Educational Research Bulletin, No. 3 (February 6, 1924), 59-64. 


® Saunders, M. Olga, “What Teachers Want from the Principal in His Capacity 
as a Supervisor.” School Review, XXX (October, 1925), 610-615. 
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as well as to characteristics of supervisors. Nutt ® used his tech- 
nique again with other groups of teachers, but regrouped the 
findings into tables of frequency in presenting the teachers’ re- 
actions to the supervision under which they had taught. He 
treated the data under three heads: “Helpful Things,” “Things 
not Helpful,” and “Helps Desired,” presenting the findings re- 
garding “special supervisors” and “general supervisors” sepa- 
rately. 

During the school year 1922-1923, Cook *° collected unsigned 
replies to a questionnaire which forty-three teachers filled in and 
returned to her, in which they confirmed their reactions to ten 
stated points. They were: 


(1) Ten qualities which seem desirable in a supervisor; (2) five qualities 
especially objectionable in a supervisor; (3) forms of help that a super- 
visor can render; (4) voice in building management; (5) innovation that 
would tend to more helpful supervision; (6) innovation that would tend 
to more democratic building government; (7) innovation that would 
enable teachers to learn most readily from the experience of others; (8) an 
experience in teaching career which was particularly helpful; (9) a par- 
ticularly unpleasant one; and (10) remarks. 


Cook tabulated the items listed by the teachers according to 
frequency of mention. 

Gist and King" utilized a less elaborate questionnaire to ob- 
tain somewhat similar information from Seattle teachers with 
respect to how principals may be most helpful. The investi- 
gators requested the information under three heads: (1) “In a 
professional way,” (2) “In an administrative way,” and (3) “In 
personal relationship.” The nature of the teachers’ reactions 
was limited, unfortunately, by the inclusion of partial lists of 
suggested types of items. The writers tabulated the returns into 
subdivisions indicating both frequency and percentage of fre- 
quency of mention. Gray’ earlier gathered similar informa- 
tion from approximately two hundred elementary school teachers 

*Nutt, H. W., Current Problems in the Supervision of Instruction, pp. 238- 
256. New York: Johnson Publishing Company, 1928. 

* Cook, Selda, ‘Teachers’ Ideas of Helpful Supervision.” Educational Ad- 
ministration and Supervision, IX (December, 1923), 554-557. 

™Gist, A. S., and King, W. A., “The Efficiency of the Principal from the 
Standpoint of the Teacher.” Elementary School Journal, XXIII (October, 
1922), 120-126. 


%Gray, W. S., “Methods of Improving the Technique of Teaching.” Ele- 
mentary School Journal, XX (December, 1919), 263-275. 
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regarding help received from principals or superintendents. He 
reported his findings by citing many concrete illustrations of 
points, but omitted the statistical data he evidently compiled to 
arrive at his conclusions. 


ELABORATELY DETAILED QUESTIONNAIRE TO TEACHERS 


In 1921, Morrison reported the reactions of high school and 
elementary school teachers of Elmira, New York, obtained by 
means of a questionnaire.’* His technique differed from that of 
the studies already mentioned in that he prepared a detailed out- 
line of the phases of supervision he had found principals and 
supervisors using in New Jersey.** In replying to the question- 
naire, the teachers indicated the specific ways that they “believed 
they had received most help from principals.” Only three items 
—personal conference, help in improving classroom management, 
and teachers’ meetings—were mentioned frequently. 

Hubbard? used a less elaborately detailed questionnaire in 
obtaining from the Detroit teachers what they expected of su- 
pervisors. The various points listed were classified under three 
major divisions: (1) general professional leadership, (2) ma- 
terial assistance (supervisory outlines, courses of study, and 
demonstration teaching), and (3) immediate personal help. Both 
Morrison and Hubbard presented their findings in terms of fre- 
quency of replies to each question included in the questionnaires. 

As one phase of a study of the value of supervision in rural 
schools, Hoppes ** used a questionnaire of ten questions designed 
to obtain rural school teachers’ appraisal of supervision and cer- 
tain definite phases of the supervisory program followed. The 
teachers answered each question by checking “Yes” or “No” 
according to the way they wished to reply to it. Their responses 
indicated that they overwhelmingly approved of supervision and 
the help resulting from it and desired its continuation. A year’s 
exposure to supervision formed their basis of judgment. 

13 Morrison, J. C., “Supervision from the Teacher’s Viewpoint.” Journal of 
Educational Method, I (December, 1921), 131-138. 

* Morrison, J. C., “Methods of Improving Classroom Instruction Used by 
Helping-Teachers and Supervisory Principals of New Jersey.” Elementary 
School Journal, XX (November, 1919), 208-216. 

*% Hubbard, Evelyn B., “What Teachers Expect of Supervisors.” Detroit 
Journal of Education, I1I (May, 1923), 416-417. 


1° Hoppes, W. C., “The Value of Supervision in the Rural Schools of Oakland 
County.” Michigan Education Association Bulletin, No. 7 (1926), 19-23. 
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Hart '’ used the same technique in constructing some of his 
questions which dealt directly with teachers’ appraisal of super- 
vision carried on by the superintendent, high school principal, 
and departmental head of the school and system in which the 
teacher worked. Both Hoppes and Hart reported their findings 
in terms of the number of teachers replying to each question. 

The last seventeen questions in Tidyman’s '* questionnaire to 
teachers contained many items of appraisal regarding specific 
phases of supervision which they had experienced. In such items 
he obtained the teachers’ reactions on a five-point scale, none, 
very little, little, much, very much being illustrative of the 
scaled expressions used by him. In answering each question, 
the teachers were to keep in mind, “What is supervision doing 
to raise the quality of discipline and instruction?” The data 
collected were presented so as to show the distribution of the 
teachers’ reactions to each. The replies point to recognition 
of supervisors’ success in general supervision but of mediocrity 
in specific supervision. Assistance by means of (1) statement 
of general principles, (2) presentation of educational philosophy, 
(3) outline of general scope of work, (4) help in planning large 
units of work, and (5) encouragement by supervisors, for ex- 
ample, was rated much. On the other hand, assistance by such 
means as (1) help in organization of details, (2) aid in dis- 
ciplinary cases, (3) guidance in planning particular lessons, (4) 
help in diagnosis, and (5) aid in the use of test results was ap- 
praised little. 

In endeavoring to obtain teacher evaluation to various phases 
of supervisory activities, Valentine ’® used a slightly different 
method for securing the appraisals from teachers. He obtained 
a list of thirty-six supervisory activities from ten mature and ex- 
perienced supervisors. Ninety-eight teachers familiar with su- 
pervision checked with a plus sign each item in the list which 
they approved and then indicated the activities they consid- 
ered most important. From the replies received, Valentine tabu- 
lated the frequency of teachers’ reactions to each supervisory 


1 Hart, M. C., “Supervision from the Standpoint of the Supervised.” School 
Review, XXXVII (September, 1929), 537-540. 

% Tidyman, W. F., “The Teachers’ Questionnaire as a Device in Supervision.” 
Educational Administration and Supervision, X (December, 1924), 553-557. 

#” Valentine, P. F., “A Job-Analysis of Elementary Supervision.” Journal of 
Educational Method, V (March, 1926), 279-282. 
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activity listed. Individual conferences, classroom demonstrations, 
group meetings with new teachers, plans made with new teachers, 
aid in the collection of instructional materials, and help through 
suggestions were checked as being most important. 

The common weakness of the techniques discussed up to this 
point lies in the type of reaction obtained from the teachers. In 
replying, they were expected to generalize their experiences with 
supervisors and supervision. The results of the studies merely 
point to the general reactions of teachers. These items needed to 
be investigated more intensively. The investigations have served 
this purpose in other studies which have acquired enhanced 
values because of the use of the lists made available in the 
above mentioned studies. 

The data accumulated in these investigations and others 
treated below lend themselves primarily to frequency distribu- 
tions and the application of statistical manipulations which such 
tabulations make possible. Mathematical treatment of the lat- 
ter type has been rarely used and quite wisely so, because of the 
nature of the findings. Little more can be concluded from such 
studies than is shown by marked frequency or marked infre- 
quency, as the case may be, of expressed opinions of the teachers. 


QUESTIONNAIRES INVOLVING TEACHERS’ REACTIONS TO 
DESIGNATED PERSONS 


Kyte *° used the questionnaire technique to obtain teachers’ 
appraisal of the helpfulness of principals, but approached the 
problem by including several departures from the methods of 
investigators discussed up to this point. He obtained teacher- 
reactions to the principal of the building in which the teacher 
replying to the questionnaire worked. The teachers in the school 
constituted a jury which formulated the one composite reply sent 
in about their principal. The post card questionnaire was re- 
turned only from schools in which were principals who agreed 
to teachers working out their replies independently of their prin- 
cipal and sending the card direct to the investigator. There 
was no means by which the principal could be identified by the 
receiver of the filled-in report. The replies were made in con- 

»™ Kyte, G. C., “The Elementary School Principal as a Builder of Teacher 


Morale.” First Yearbook, Department of Elementary School Principals, Michi- 
gan Education Association (August, 1927), 44-52. 
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siderable detail to two questions: (1) “In what ways do you 
find your principal most helpful to you?” and (2) “What fur- 
ther help would you like from him?” The results were presented 
in both frequency and percentage distributions according to the 
sex of the principals. A typical reply was included in the study 
to illustrate the responses of teachers. 

Using the findings of Kyte’s study, Bowen! constructed a 
questionnaire in which teachers were to indicate on a five-point 
scale the value they attached to each item listed and to rank 
the items according to their importance as sources of help to 
teachers. The replies of the many Detroit teachers were tabu- 
lated under classifications of teachers according to (1) the gen- 
eral merit rating each teacher had received during her years of 
teaching in the city and (2) the length of time each had been 
engaged in teaching. The manner in which the data were assem- 
bled made possible, therefore, an analysis of the reactions of 
teachers in accordance with (1) their general ability rating, (2) 
their teaching experience, and (3) both their merit rating and 
their teaching experience. Bowen also compared his general 
findings with those in Kyte’s study. 

The questionnaire technique used by Temple ** was similar in 
many respects to that used by Kyte. She sought the reaction 
of teachers to the nature of the helpfulness of a selected type of 
supervisor—the kindergarten-primary supervisor. The state- 
ments received about such persons were confined to things done 
by them which teachers found helpful. The returns were from 
ten cities located in nine states. The number of times each 
specific activity was mentioned was determined from the re- 
plies. 

Melby ** used an elaborate technique for obtaining teacher 
evaluation of supervisory activities listed in great detail in his 
questionnaire: He gathered from the educational literature a list 
of all supervisory activities and devices mentioned, classified 
them under five major heads, and included all of the items in the 
two forms he constructed. The first questionnaire was answered 


“™ Bowen, D. C., What the Teacher Expects of the Principal. A research study 
on file at the University of Michigan, 1928. 

™Temple, Alice, “Value of Supervision from the Standpoint of the Teacher.” 
Childhood Education, IV (March, 1928), 315-317. 

@Melby, E. O., “Teacher Evaluation of Supervisory Procedure.” Scientific 
Method in Supervision, Second Yearbook. National Conference of Supervisors 
and Directors of Instruction (1929), Chap. XVIII. 
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by the teachers’ indication of how frequently the supervisors “in 
your system” used each activity and device. As soon as this 
questionnaire was answered, the teachers were given the second 
one containing the same list, but this time were instructed to 
indicate their judgment of the value of the activity. The five 
degrees of quality—some value, little or no value, undesirable, 
and should not be used—were the designated values to be 
checked. 





QUESTIONNAIRES TO THE SUPERVISORS FOR REPORTING PRACTICE 


Kibbe ** indicated the relative importance attached to super- 
visory techniques by swmmarizing the number of hours spent 
by rural school supervisors in Wisconsin as reported by them in 
their replies to her questionnaire regarding the use of their time. 
Her summary of the findings is presented in terms of the total 
number of hours reported consumed by all of the supervisors in 
carrying on each activity. 

Several studies of the distribution of the use of the princi- 
pal’s time have been made and central tendencies computed. The 
data used were obtained from principals who kept detailed rec- 
ords of how their time was spent while at work. The findings 
are presented in percentages which are assumed to indicate rela- 
tive importance of use of various types of activities.2> The most 
intensive and detailed study of this nature has been made by 
Hampton * from diaries kept daily by one hundred and thirty 
principals. All types of activities of the principal are included, 
most of the more or less supervisory ones being classified under 
the major heads, “Supervision of Instruction” and “Adminis- 
tration of the School.” 

Risk’s 7? study of the distribution of time reported by one 
hundred and fifty-nine special supervisors employed in cities of 
20,000 population and over, in different parts of the United 
States, was very similar in method to that used by Hampton. 


%*Kibbe, Delia, “An Analysis of Activities of Rural-School Supervisors.” 
Elementary School Journal, XXVIII (January, 1928), 346-352. 

% For most of the references, see list in Seventh Yearbook, Department of 
Elementary School Principals, National Education Association (1928), Chap. V. 

% Hampton, W. O., How Public School Principals Use Their Time. Unpub- 
lished doctor’s dissertation, University of North Carolina, 1926. See M. R. 
Trabue's summary in Educational Supervision, First Yearbook, National Con- 
ference on Educational Method (1928), Chap. X. 

7 Risk, T. M., Supervisory Organization and Procedure in Public Schools. 
Unpublished master’s thesis, University of Wisconsin, 1925. 








48 THE EVALUATION OF SUPERVISION 


The results are given in percentage of time consumed by special 
supervisors engaged in each activity. In the studies by Halnon ** 
and by Thune,”* research techniques were used which are simi- 
lar to those used by Risk. Such other procedures as they utilized 
have been reported above regarding other investigations. 

Although Huff’s *° study was made to obtain reports of prac- 
tice rather than appraisal, the distribution of replies to his ques- 
tionnaire indicates the importance superintendents in small school 
systems attach to various phases of supervision carried on by 
themselves as shown by the number of times the activities listed 
were checked either “Yes” or “No.” The relative weight of group 
judgment as to the value of specific phases of activities is clearly 
shown by the following samplings from the tabulated conclu- 
sions: 


Do you take notes while visiting classrooms? Yes, 19; No, 52. 
Do you try to get your impressions to the teacher by 
individual conference after each visitation? Yes, 68; No, 6. 


QUESTIONNAIRES INVOLVING UsE or ACCREDITED JURY 


The elementary school principals’ appraisal of the supervisory 
means used by superintendents in fifty cities of 10,000 to 15,000 
population is reported by Kyte.*t The percentage of superin- 
tendents reported by the principals as using each means was 
computed. In addition, the items were ranked according to their 
importance by the principals in thirty-two of the cities and the 
composite rank of importance computed from the thirty-two re- 
plies. In all cases, the questionnaires were sent by the principal 
to the investigator with the approval of the superintendent but 
without the superintendent seeing the reactions of the principal. 
Neither the name of the principal replying nor that of the super- 
intendent appeared on the reply. The means ranked as most im- 
portant were (1) personal conferences held by supervisor, super- 
intendent, and principal, (2) group meetings held by super- 

* Halnon, May, The Present Status of Elementary Supervision. Unpublished 
master’s thesis, Indiana University, 1924. 

* Thune, E. T., The Place and Function of Supervisors of Special Subjects in 


City School Systems. Unpublished master’s thesis, University of Washington, 
1926. 


* Huff, L. W., The Nature of Supervision of City Superintendents in Small 
School Systems. Research study on file at the University of Michigan, 1928. 
Summarized in Kyte, G. C., How to Supervise, pp. 75-80. 

™ Kyte, G. C., How to Supervise, pp. 80-82. Boston: Houghton Mifflin, 19380. 
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visor, (3) demonstrations by superior teachers, (4) directed 
visitation, (5) demonstrations by supervisor, (6) recognition 
of teacher’s creative work, and (7) supervised experimenta- 
tion. 

In another study, Kyte ** reversed the two groups, obtaining 
the superintendents’ judgments regarding the supervisory aid 
which they believe principals should give to new and inexperi- 
enced teachers. He also gathered principals’ reactions to their 
own responsibilities toward the new teacher. The two sets of 
distributions were presented in the one study according to num- 
ber and percentage of times each item was mentioned, so that the 
sets of evaluations could be compared and analyzed at the same 
time. 

An analogous study was made regarding the nature of super- 
visory aids which superintendents stated they should give to new 
and inexperienced teachers.** Frequency distributions and per- 
centages were made of the superintendents’ replies. In this 
study and in the preceding one mentioned, the investigator ex- 
panded his treatment to incorporate the conclusions to be drawn 
from the educational literature bearing on this subject, together 
with the accumulation of conclusions from personal experiences 
of himself and many others. 

Approximately the same procedure had been used previously 
by Daily * in her investigation of the duties and responsibilities 
of general supervisors in elementary schools. She obtained rank- 
ings of activities of these supervisory officers from (a) 76 of 
their number, (b) 116 superintendents, and (c) 6 “leading edu- 
cators.” The data from each group were treated separately 
and then compared and contrasted. 

In “The Supervisor’s Job,” Mead * presents the composite 
ranks given to six generalized statements of supervisory duties 
as rated by two small groups of teachers, principals, and super- 
visors registered in his classes in 1923 and 1924. The report 
contains the two sets of rankings, showing the very marked 
agreement in the composite judgments of the two groups. 


83 Kyte, G. C., op. cit., pp. 400-402. 

% Ibid., pp. 386-396. 

* Daily, Mary J., The Functions, Qualifications, and Working Relations of 
the General Supervisor in the Elementary Schools. Unpublished master’s thesis, 
Indiana University, 1925. 

%> Mead, C. D., “The Supervisor’s Job.” Journal of Educational Method, IV 
(March, 1925), 270-272. 
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The major parts of Weber’s ** study were carried on by means 
of two questionnaires. From a preliminary questionnaire, he 
obtained a list of “devices recommended by county superin- 
tendents (in Nebraska) for the improvement of rural instruc- 
tion.” Ninety of the items obtained by this means were listed 
in the second questionnaire, which was then submitted to (1) the 
county superintendents, (2) normal training teachers, (3) rural 
school teachers, and (4) a miscellaneous group of state officers, 
normal school instructors of rural education, and the like. The 
questionnaire was so designed that the replies indicated the 
evaluation of the items on a three-point scale: great value, aver- 
age value, little or no value. Frequency tables were constructed 
in which the data from the first three groups were placed in 
parallel columns. 


QUESTIONNAIRE STUDIES OF THE VALUE OF CERTAIN SUPER- 
visoRY ACTIVITIES 


Several questionnaire studies have been made to determine 
personal evaluation of various types of supervisory procedures. 
The first of these investigations, reported by Ayer,** was car- 
ried on to obtain rural school teachers’ appraisal of the group 
teachers’ meeting. The questions provided for general appraisal 
of the meetings, evaluation and listing of the specific help re- 
ceived, appraisal of the activities occurring in the meetings, and 
suggestions for improvement of them. 

West ** made a similar study regarding the value of a demon- 
stration school by obtaining the reactions of teachers and prin- 
cipals who had visited the classes in it. 

The most intensive study published to date using the ques- 
tionnaire as a means of obtaining teachers’ appraisal of a specific 
supervisory activity has been made by Lindquist.**® In his in- 
vestigation, the reactions to (1) principals’ meetings with 
teachers, (2) supervisors’ meetings with teachers, (3) principals’ 

%* Weber, D. H., The Status and Evaluation of Devices Recommended by 
County Superintendents for the Improvement of Rural Instruction. Unpub- 
lished master’s thesis, University of Nebraska, 1929. 

37 Ayer, Adelaide M., ‘“‘What Rural Teachers Think of Group Teachers’ Meet- 
ings.’ Journal of Rural Education, I (September, 1921), 20-23. 

* West, R. L., “Teacher-Training Through a Demonstration School.” Zle- 
mentary School Journal, XXV (April, 1925), 619-626. 


* Lindquist, R. D., “The Evaluation of Supervision.” Educational Adminis- 
tration and Supervision, XV (April, 1929), 301-310. 
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classroom visitation, and (4) supervisors’ classroom visitation 
were tabulated and analyzed. The compilations were made 
from the anonymous reports of the teachers for the purpose of 
helping the supervisory officers in becoming more effective in 
their supervision. Replies to each question were classified and 
tabulated to indicate all specific types of criticisms and sugges- 
tions made by the teachers. 


Tue USE or THE INTERVIEW IN THE APPRAISAL 
OF SUPERVISORS 


Few studies have been made in the appraisal of supervision in 
which the use of the interview occurred as the predominant 
technique. The study by Morrison *° most closely approximates 
this type of research. He kept a list of the items obtained from 
forty interviews with employers of teachers, classified the specific 
reactions, and tabulated them. He treated the data in two 
distinct ways. He first presented the results in (1) rank order, 
(2) frequency of mention, and (3) percentage of persons inter- 
viewed who mentioned each item listed. His second presentation 
consisted of listing in detail the specific statements made by the 
interviewed with respect to the individual discussed, such state- 
ments being classified under their respective heads. 

Hubbard * used the interview with 46 elementary school prin- 
cipals in an endeavor to ascertain why they were designated by 
their superintendents as “successful” in their work. From his 
interviews and observations, he selected six outstanding princi- 
pals and wrote case studies which were published in his report. 
He also summarized the outstanding personal qualities noted in 
these individuals and the prominent characteristics of their 
schools. A second phase of the reported study consists of numer- 
ous examples of “methods of organization or ways of doing 
things” noted by Hubbard in the 45 schools visited. The 
investigator inferred that the principals were directly or in- 
directly influential in producing the fine educational activities 
recorded. 

“ Morrison, R. H., “Qualities Leading to Appointment as School Supervisors 
and Administrators.” Educational Administration and Supervision, XII (No- 
vember, 1926), 505-511. 


"Seventh Yearbook, Department of Elementary School Principals, National 
Education Association (1928), Chaps. XV and XVI. 
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Tue Use or a Group oF TECHNIQUES INVOLVING PERSONAL 
REACTIONS AND OBSERVATIONS 


Hughes and Melby * included personal visitation, interview, 
classroom analysis, and the questionnaire in making most of the 
appraisal studies included in their investigations. The findings 
are included in a series of unit studies scattered throughout their 
book. The specific research techniques do not differ from those 
presented above regarding other studies. 


INTEGRATION OF FINDINGS FROM A VARIETY OF SOURCES 


Briggs *®° used a procedure involving the integration of data 
from a number of sources. She tabulated the frequency of men- 
tion of activities of special supervisors from the statements of 
“educational experts” and superintendents of schools, from the 
rules of boards of education, from reports of supervisors, and 
from analyses of professional literature on supervision, including 
school surveys. The items from all sources were assembled into 
a table of frequencies. 


“® Hughes, J. M., and Melby, E. O., High School Supervision. Bloomington, 
Ill.: Public School Publishing Company, 1930. 

* Briggs, Delia C., The Duties and Responsibilities of the Supervisor. Un- 
published master’s thesis, University of Chicago, 1925. 




















CHAPTER V 


ILLUSTRATIONS OF TECHNIQUES USED IN THE 
EVALUATION OF SUPERVISION (Continued) 


In the preceding chapter research studies dealing with the 
appraisal of supervision illustrate investigations in which use 
was made primarily of four types of approaches: the question- 
naire, the jury, the interview, and the case study. The present 
chapter contains summaries of the research techniques involving 
evaluation of supervision through the use of an experimental 
group, equivalent groups, a score card, and a comprehensive pro- 
gram including many of the means. 


MEASUREMENT OF PupiL ACHIEVEMENT WITH SUPERVISION THE 
ASSUMED VARIABLE 


Testing programs have been used in many different ways in 
endeavors to obtain measures of the effects of supervision. The 
periods in which supervision was carried on as an experimental 
factor vary from a few weeks to many years. 

The study by Crouch? illustrates one type in which the short 
period of experimentation was used. Initial and final tests were 
given in language and composition to obtain evidences of gain 
in achievement. Fourteen pupils were given instruction in lan- 
guage twenty minutes a day for twenty days. “The teacher was 
closely supervised in all her work. The supervisor planned every 
lesson taught, both as to content and method, assisted the teacher 
in analyzing each pupil’s language difficulties, and suggested 
specific treatment for each type of error found.” Each lesson 
was intensively checked and evaluated and plans for the next 
one made accordingly. Standard scores for the tests were ascer- 
tained, median achievement scores on the various tests were 
computed, and, from the medians, percentages of gains were cal- 
culated. Crouch recognized the weakness of his study, stating 

1Crouch, R. A., “A Study in the Supervision of Language Teaching.” Edu- 


cational Administration and Supervision, XII (January, 1926), 49-54. 
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that “as a controlled group was not used in the experiment, it is 
not possible to state to what extent the results secured are due 
to supervision alone.” 

O’Brien ? used the same technique in his “Experiment in Super- 
vision of English” in two small schools in Grades VII-XII, the 
period of time devoted to supervision of the teaching between 
initial and final tests being longer. Daniel* applied the same 
procedure also in a program of supervision of rural school teachers 
in the teaching of letter writing. Teachers received a variety 
of helps through an extensive supervisory program. “Two in- 
formal dictation tests” were constructed and used as means of 
obtaining measures of gains in pupils’ achievement. Statistical 
data were omitted from the published report. 


COMPARISON OF ACHIEVEMENTS OF COMPARABLE PUPILS IN 
THE SAME GRADE 


In Measuring Efficiency in Supervision and Teaching, Crabbs * 
reports a measurement program in which the data from the 
initial tests were intensively and extensively analyzed and the 
teachers given the detailed information and considerable help in 
determining what to do with their classes and with the individual 
pupils in the groups in order that better achievement might re- 
sult. The end tests were given one year after the initial tests. 
The achievements of pupils in the 1922 tests in Grades III-VIII 
were compared with the achievements of pupils in the 1923 tests 
in the corresponding grades. The differences, in the various sub- 
jects tested, favoring the children tested in 1923 were attributed 
to the effects of supervision which their teachers had received. 
The assumption was made that the children in each grade in 
1922 were comparable in every respect to those in the cor- 
responding grades in 1923 and that better learning of the latter 
was due to the better teaching caused by the supervisory pro- 
gram. Equivalence of groups was partly established by Crabbs’ 
use of McCall’s technique for converting test scores into age 
scores. ; 


20’Brien, F. P., “An Experiment in Supervision of English.” Journal of 
Rural Education, V (January-February, March-April, 1926), 204-218, 330-343. 

* Daniel, Mary L., “A Supervisory Project in Letter-Writing.” Hlementary 
School Journal, XXVII (October, 1926), 123-133. 

*Crabbs, Lelah M., Measuring Efficiency in Supervision and Teaching. Con- 
tributions to Education, No. 175. New York: Teachers College, Columbia Uni- 
versity, 1925. 
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Lederle ® and his corps of rural school supervisors used the 
same technique in comparing the achievements of children in 
Grades III-VIII in 1923 with the achievements of children in the 
same grades in 1929. In addition to the data obtained from 
the two sets of tests, comparisons were made of data regarding 
(1) training, experience, age, tenure, and salary of teachers, (2) 
percentage of attendance of teachers at supervisory meetings, 
(3) changes in school plants and school equipment, (4) in- 
creases in the supervisory staff due to teachers’ increased re- 
quests for help, and (5) increase in regularity of pupils’ at- 
tendance at school. The 1929 findings were considerably more 
satisfactory than the 1923 findings. 

Shaw * carried on a similar type of study in handwriting, com- 
paring the results of pupil achievement in tests given in Febru- 
ary, 1927, September, 1929, and January, 1930. Each survey 
included the pupils in Grades 2L to 12H and the students in 
Detroit Teachers College. 

Numerous investigations of the types indicated in the brief 
summaries of the procedures used by Crouch, O’Brien, Daniels, 
Crabbs, Lederle, and Shaw were reported to the committee. 
Since the procedures used merely duplicate those reported above, 
they are omitted. They add to the amount of evidence, however, 
which seems to show that supervision contributes to improve- 
ment in teaching, in learning, and in other conditions affected 
by such achievements. 


CoMPARISON OF ACHIEVEMENTS OF PupiLts INVOLVING 
EXPERIMENTAL GROUPS AND CoNTROL GROUPS 


In the two-year experiment carried on in Indiana to prove the 
value of rural school supervision, more conclusive findings were 
obtained because of the use of experimental groups and control 
groups.” The schools in two counties were supervised by trained 
supervisors during the period of the experiment. Two other 


5 Lederle, E. J., et al., A Re-Survey of the Rural Schools of Oakland County, 
Michigan. Mimeographed report, March 1, 1930. 

*Shaw, Lena A., Improvement in Handwriting in the Detroit Schools. A 
summary of the study furnished to the Yearbook Committee, 1930. 

t Burris, B. J., “Preliminary Report on Supervision in County Demonstra- 
tions,” Educational Bulletin, No. 74, Indiana State Department of Public In- 
struction, 1924. 

Sherwood, H. W., “Value of Rural School Supervision.” Educational Bul- 
letin, No. 84, Indiana State Department of Public Instruction, 1926. 
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counties markedly comparable were chosen as controls, no trained 
supervisors being added to the county superintendents’ staffs. 
Batteries of tests were given in all grades of the rural schools 
from the third to the eighth at the beginning and end of each 
school year. Progress of pupils in achievement each year was 
computed in terms of the fraction of the year’s work mastered 
in each subject tested. A composite score was derived also. 
The difference between the pupils’ yearly progress, as determined 
by the achievement indices, between the experimental counties 
and the control counties was attributed to supervision in the 
former. The markedly better achievement in the second year as 
compared with the first year of the experiment was also used as 
evidence of the effects of supervision. 

Southall ® followed the same experimental procedure in her 
study of the value of supervision in an “experimental pair” of 
consolidated schools and a “control pair” of markedly compara- 
ble ones. In selecting equivalent groups, she added to initial 
achievement test results evidence of marked likeness in (1) 
types of school, (2) length of school term, (3) enrollment in and 
number of grades, (4) training, experience, and tenure of 
teachers, (5) mental status of the children as measured by in- 
telligence tests, (6) nationality of the children, and (7) super- 
vision by the county superintendent. When the equivalence be- 
tween the two groups was established in these aspects, Southall 
undertook an intensive program of supervision of the two schools 
in the experimental group, assuming that this supervisory work 
would constitute the variable. The same types of measures of 
effectiveness of supervision were applied in this study as were 
used in the Indiana experiment, and similar results were ob- 
tained. 

Hoppes’® study was very similar but more extensive. Using 
approximately the same elaborate set of criteria, he matched 
one-room rural schools in County A with one-room rural schools 
in County B, thus locating 43 pairs of schools. The 43 schools 
_ in County A were designated the experimental group, the vari- 
able factor being the work of two “helping teachers” or rural 


* Southall, Maycie, “A Study of the Value of Supervision in Consolidated 
Schools.” Hducational Bulletin, No. 106, North Carolina State Department of 
Public Instruction, 1925. 

® Hoppes, W. C., “The Value of Supervision in the Rural Schools of Oakland 
County.” Michigan Education Association Bulletin, No. 7, 1926. 
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school supervisors during the year of the study. The 43 County 
B rural schools in the control group were given no such super- 
vision. From the results in achievement in initial and final tests, 
computations were made to indicate the percentages of a normal 
year of school work completed by the pupils in various grades. 
The differences favoring the supervised schools were attributed 
to the supervisory work of the helping teachers in the experi- 
mental group. 

Other reported studies following very closely the techniques 
used in the types of equivalent-groups experimentation presented 
above have been made by Lombard,’ Prewit and Manuel," 
Weidman and Lessenger,? and Bennett and Acker.** Lombard’s 
study of rural school supervision in Louisiana is much the same 
as the ones which were carried on earlier in other states. Prewit 
and Manuel limited their investigation to a comparison of 
achievement in handwriting of pupils in schools supervised by a 
supervisor of penmanship and that of pupils in schools not so 
supervised. Bennett and Acker used two equivalent groups of 
seven schools each in Albemarle County, Virginia. The one 
group of schools for negro children was supervised and the other 
comparable group for negro children was unsupervised. 

Two features in the study by Weidman and Lessenger make 
it unique because of the application to investigations designed 
to measure the effects of supervision. In order to compare the 
handwriting achievements of pupils in City X, which makes no 
provision for special supervisors of penmanship, with that of 
the pupils in City Y, which has this type of supervision, pupils in 
City X were matched with pupils in City Y. This feature re- 
sulted from matching of the pupils based upon “grade, age, sex, 
nationality, and total number of years in school” of each pupil. 
The similarity of industrial activities occurring in the two cities 
led to selection of City X for purposes of comparison with City 

® Lombard, J. E., “Notes on an Wxperiment in Supervision,” reported in 
Eighth Yearbook, Department of Superintendence, National Bducation Associa- 
tion, 1930, p. 102. 

™ Prewit, Irene, and Manuel, H. T., “Differences in the Handwriting of Su- 
pervised and Unsupervised Pupils.” School and Society, XXXI (March 1, 1930), 
 ieieniies regarding the study was reported to the Yearbook Committee 
ee A. Shaw for Agnes A. Weidman and W. B. Lessenger of the Detroit 


% Information regarding the study was reported to the Yearbook Committee 
by H. G. Acker. 
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Y. “Seventeen hundred handwriting specimens from matched 
pupils were thus obtained.” The second feature of the study con- 
sisted in the procedure involving the obtaining of scores of hand- 
writing quality. All specimens were keyed so that only the 
investigators could identify the source of a test specimen. Every 
paper was scored by two persons in the Detroit school system 
and two handwriting supervisors or assistants employed in six 
other cities, a large number of scorers thus being used. The 
average score was computed for each paper. 


INTENSIVE AND EXTENSIVE EXPERIMENTATION TO OBTAIN 
MEASURES OF EFFECTS OF SUPERVISION 


One of the first studies involving intensive and extensive sur- 
vey and experimentation was made by Kyte * over a period of 
four years beginning in 1918. The investigation included: 


1. An intensive survey of 

. The school community 

. The parents of the pupils 

. The school plant 

. The equipment 

. The teaching staff 

. The rate of progress, intelligence scores, and achievement scores 

of the pupils 

2. The supervisory activities of the principal 

. Careful analyses of the amassed survey data 

. Provisions for furnishing the detailed information to the teachers 

c. Institution and performance of an intensive continuous program 
of testing and diagnosis 

d. Reorganization of the school 

e. Regrouping of pupils and providing for ready readjustments of 
individuals and groups 

f. Case studies 

g. Assistance to the teachers in modifying their methods of teaching 

h. The commonly used supervisory activities 


3. The measurement of the effects of the principal’s activities 
a. Comparisons of various types of educational achievements of 
pupils in the several grades and kindergarten, with corresponding 
data regarding comparable schools in the system and the city- 
wide data 


moan Oo & 


oe 


“ Kyte, G. C., Reorganization and Administration of an Elementary School 
to Meet the Needs of a Community. Doctor’s dissertation, University of Cali- 
fornia, 1922. Also an abridgement, published as: Reorganization and Admin- 
istration of an Elementary School to Meet the Needs of a Community. Uni- 
versity of California Publications in Education, II (January 12, 1925). 
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b. Presentation of successive semi-annual and annual scores of 
achievements and progress records compiled regarding the pupils 
in this experimental situation 

. Comparison of these data with the standard scores and indices 

d. Use of experimental and control groups to indicate effects of 

specific phases of the experimentation 

e. Record of changes in teaching methods and professional growth 

of teachers 

f. Follow-up records regarding the pupils promoted to the junior 

high schools 

g. Illustrations of changes in parents’ attitudes toward the school 


° 


In a later follow-up study of the effects of the experimental 
program on gifted children, Kyte *® accumulated data regarding 
these pupils as they progressed through the junior high schools. 
In this supplementary investigation, he obtained ultimate effects 
of the experimental program on the pupils by means of measures 
of (1) scholastic achievement as indicated by term marks in the 
various subjects studied in the secondary schools, (2) rate of 
progress in these schools, and (3) principals’ and teachers’ esti- 
mates of (a) each pupil’s attitude toward school, (b) his attitude 
toward life, (c) extent of his adjustment to the social group in 
which the previous experimental program has led him to be 
placed, and (d) other specific evidences of the effects of the ex- 
perimental program. The follow-up study provided, therefore, 
a series of measures which could not be made until considerable 
time had elapsed since the completion of the three years of ex- 
perimentation. The mass of evidence accumulated in the two 
studies markedly favors supervision as a major activity to be 
carried on by a principal. 

The experiment by Collings '* is very similar in many respects 
to the earlier one by Kyte. Collings limited his study to the 
measurement of equivalent groups, a special type of supervision 
of one group being set up as the variable. This type consisted 
of supervisory activities designed to modify teaching and learn- 
ing in the experimental school so that a “project curriculum” 
became the basis of school work. The study was carried on in 
rural schools. In addition to comparing the achievements of 

% Kyte, G. C., “Two Types of Experimental Programs in the Education of 
Gifted Children and Their Ultimate Effects.” National Education Association, 
Third Yearbook, Department of Elementary School Principals, (1924), 395-430. 


48 Collings, E., An Eaperiment with a Project Curriculum. New York: Mac- 
millan Co., 1923. 
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matched pupils in the two groups, Collings emphasized, in his 
investigation of results, (1) changes in many attitudes of pupils 
toward the school and its improvement, (2) changes in the atti- 
tudes of parents toward the school and its improvement, (3) 
changes in the children’s community life, (4) changes in the 
adults’ community life, and (5) increases in community conveni- 
ences. The results illustrate clearly what a county superintend- 
ent can achieve through intensive supervision of rural schools. 

The investigation by Irwin and Marks," although quite simi- 
lar to those by Kyte and by Collings with respect to techniques 
used, was treated with much less statistical evidence included. 

Pittman’s ?* pioneer study was made to determine the results 
of a certain type of supervisory program. His problem was 
to study the effects of supervision in rural schools under the “zone 
plan.” The investigation involved an experimental group of 
schools in which Pittman carried on his program of supervision 
and an equivalent control group of schools not given the benefit 
of his supervision. Various types of supervisory activities were 
included in the work of supervision of the experimental group 
of schools. Two batteries of tests were used, one at the begin- 
ning of the program and one some seven months later. All chil- 
dren in the experimental groups were matched with comparable 
cases in the control groups according to initial test scores. The 
114 matched pairs were used to indicate the increased achieve- 
ments of the pupils in various subjects, the differences favoring 
the experimental group being attributed to the effects of super- 
vision. In Pittman’s conclusions are included results other than 
the test data, desirable growth in the reactions of children, of 
parents, and of teachers being presented. 

Corning’s ?* report of a testing program indicates use of some 
of the procedures followed in the three investigations just pre- 
sented. Since his study was not primarily planned to obtain 
measures of the effects of supervision, not much attention is 
paid to obtaining clear-cut indices of this nature. He was pri- 
marily interested in presenting the effects of a testing program. 


1 Irwin, Elizabeth A., and Marks, L. A., Fitting the School to the Child. 
New York: Macmillan Co., 1924. 

% Pittman, M. S., The Value of School Supervision. Baltimore: Warwick and 
York, 1921. 

*® Corning, H. M., After Testing—Whatf Chicago: Scott, Foresman and Co., 
1926. 
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The same interest dominated the investigations made by 
Brooks,”° Clapp,” and Ford.22, Many similar studies have ap- 
peared in the widely circulated educational periodical literature 
and in the yearbooks of the Department of Elementary School 
Principals, National Education Association. 


CoMPARISONS OF THE EFFECTS OF TYPES OF SUPERVISION 


The first published statistical study designed to measure the 
relative effects of defined types of supervision was reported by 
Courtis.* Initial tests were used in Grades 4H-6H to determine 
how to divide the schools into four groups with the same initial 
composite score. A type of supervisory program was planned 
for and conducted in each of the four groups as follows: 


Group I. Unsupervised (“mere giving of tests”) 


Group II. Inspected (“schools visited on old inspection basis”; super- 
visor did not see test results) 


Group III. Supervised by schools (supervisor informed of test results; 
visited schools of lowest standing in this group and made 
sure that principals and teachers understood what they were 
expected to do and that they were using the best methods) 

Group IV. Supervised by classes (supervisor informed of details of class 
scores; spent time with the teachers whose classes were below 
the general level) 


After six weeks of these types of supervisory activity were 
completed, tests were again given. In the final treatment of the 
data, only the scores of children present for both tests were used, 
care being taken that the composite score for each group on the 
initial test was the same as that for every other group. The 
computed gains and “per cents of desired gain” were used as 
indices of the relative effectiveness of the types of supervision 
employed. 

Shaw ** followed the same technique in detail, measuring 

*” Brooks, S. S., Improving Schools by Standardized Tests. Boston: Hough- 
ton Mifflin, 1922. 

2 Clapp, F. L., “Standard Tests as Aids in School Supervision.” University 
of Wisconsin Studies in Social Science and History, No. 8, 1922. 

@=Ford, F. A., “Diagnostic Supervision.” Journal of Louisiana Teachers’ 
Association, I (April, 1924), 30-35. 

* Courtis, S. A., “Measuring the Effects of Supervision in Geography.” School 
and Society, X (July 19, 1919), 61-70. 

* Shaw, Lena A., “An Evaluation of Four Types of Supervisorv Procedures in 


Handwriting.” Highth Yearbook, Department of Superintendence, National 
Education Association (1930), 106-107. 
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the effects of the supervisory procedures when applied to 
helping teachers improve in the teaching of handwriting. Pupils 
in Grades III-VIII were included in this experiment. Both 
Courtis’ and Shaw’s studies resulted in scores which indicated 
supervision by classes to be superior to supervision by schools, 
supervision by schools superior to inspection, and inspection 
better than no supervision. 

In Fuller’s ** study of the relative effectiveness of individual 
supe: visory conferences and supervisory teachers’ meetings, he 
rendered constant the time of the supervisor devoted to each 
type of conference. Three comparable groups of one-teacher 
rural schools were selected after a study of the communi- 
ties, teachers, and the intelligence and achievement test data 
regarding the pupils enrolled. The three groups were as fol- 
lows: 


Group I. Control (given the same initial and final batteries of tests 
as the experimental groups) 

Group II. Experimental (given the batteries of tests; each teacher ob- 
served at work once a month on the subject tested, the 
supervisor remaining about 75 minutes observing in each 
teacher’s room; two-hour supervisory meetings held for the 
group each month) 


Group III. Experimental (given batteries of tests; each teacher observed 
at work once each month on the subjects tested, the super- 
visor remaining about 75 minutes observing in each teacher’s 
room; a_fifteen-minute supervisory conference was held with 
each teacher during the day of the supervisor's observation) 


Various types of statistical measures were computed for sev- 
eral refinements in the grouping of the data. These measures 
were obtained from the distributions of scores for (1) all children 
in each group; (2) all pupils in each group with reference to the 
respective grades in which they were enrolled; (3) all pupils 
present for each test and taught by matched trios or pairs of 
teachers; (4) initial matched trios of pupils and pairs of pupils; 
and (5) initial matched pupils taught by matched teachers. 
The many differences in gains computed were analyzed and 
discussed, the investigator concluding that the individual 


* Fuller, H. H., The Relative Effectiveness of the Group Supervisory Confer- 
ence and the Individual Supervisory Conference. Unpublished doctor’s disserta- 
tion, University of Michigan, 1929. See excerpt in Highth Yearbook, Depart- 
ment of Superintendence, National Education Association (1930), 336-338. 
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supervisory conference procedure had produced better results 
than the supervisory group meeting. 


MEASURING THE EFFICIENCY OF SUPERVISION BY MEANS OF A 
Score Carp 


Brueckner and Cutright ** describe a plan of supervision for 
improving teaching of work reading in which a score card serves 
both as a means of diagnosis of teaching and as a means of meas- 
uring the efficiency of supervision. The outline on the score card 
is a very detailed one designed to make possible an intensive 
study of the teaching and learning activities involved. When the 
results of scoring 620 lessons were tabulated, they were used as 
the basis for planning and instituting an organized program of 
supervision. The final survey consisted of scoring 625 observed 
lessons. The extent of recorded shifts in various phases of teach- 
ing was attributed to the supervisory program instituted. 

Price’s 2” reports of an unfinished study, which is well under 
way, indicate that she is conducting a similar study involving 
the supervision of the teaching of geography in the Monroe, 
Michigan, schools—changes in teaching are measured by the 
use of scaled words—describing specifically each aspect of teach- 
ing included on the score card. 


APPLICATION OF THE ACCREDITED JURY METHOD 


Kyte and Hersh ** have completed a study in which “a jury 
of experts” was used to determine the immediate effects of a 
supervisory conference on the classwork of the teacher. Ten 
pairs of stenographic records of teaching were selected at ran- 
dom from a number of pairs, various subjects and the work of 
teachers of varying degrees of skill being included. A pair con- 
sisted of the stenographic records of two observed lessons taught 


% Brueckner, L. J., and Cutright, Prudence, “The Techniques and Evaluation 
of a Supervisory Program in Work Reading in the Minneapolis Public Schools.” 
Minneapolis Public Schools, Educational Bulletin No. 12 (April, 1927). 

Brueckner, L. J., and Cutright, Prudence, “A Technique for Measuring Effi- 
ciency in Supervision.” Journal of Educational Research, XVI (December, 1927), 
323-331. 

™ Price, Maud, Measuring the Growth of Teachers in the Teaching of Geog- 
raphy. Preliminary reports and score cards on file at the University of Michi- 
gan, 1930. 

* Kyte, G. C., and Hersh, T. R., Immediate Effects of a Supervisory Confer- 
ence on Teaching. Unpublished study on file at the University of Michigan, 
1930, 
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by the same teacher from two to four weeks apart. Between the 
first and second lesson in each case a planned supervisory con- 
ference was held with the teacher by a supervisory officer regard- 
ing the first lesson. 

Forty experienced supervisory officers were asked to determine 
which lesson in the pair was the better and to state why it was 
better. The judges were not aware that a supervisory confer- 
ence had occurred between the two lessons. Twenty judgments 
were obtained for each pair. Provision was made for the alter- 
nation of exposures to each lesson in a pair, part of the judges 
reading the first lesson first and the other part reading the second 
lesson first. The judges did not know which lesson of a pair 
was taught first. 

The effects of supervision were measured in two ways. The 
first measure was obtained by tabulating the frequencies of 
ratings designating the one lesson as better than the other. The 
second measure was obtained by evaluating the frequency dis- 
tributions of reasons given by the judges for considering the 
one lesson better than the other in the pair. Comparisons were 
then made of the distributions of judges’ reasons and the evalu- 
ations with the points stressed by the supervisory officer in the 
conference with the teacher. The second measure used proved 
especially helpful in studying two cases in which the ratings of 
the judges did not indicate a clear-cut superiority of one lesson 
over the other. The study showed that specific improvements 
in teaching result from a supervisory conference held with the 
teacher. 


AN INTENSIVE AND COMPREHENSIVE APPRAISAL OF SUPERVISION 


By far the most intensive, detailed, and comprehensive study 
in the appraisal of supervision has been undertaken by Essery.”® 
Representative schools in three cities are included, constituting 
three variables, the basic differences in the three resting upon 
their respective philosophies of education. The numerous tech- 
niques used are applied to the subject of spelling. 

The research techniques include: 


1. A study and classification of the philosophy existing in each school 
system 


*Essery, Florence V., A doctor’s dissertation to be submitted at the Uni- 
versity of Michigan, almost completed at this writing. 
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2. The construction and use of a battery of tests to measure various 
aspects of spelling achievement 
3. The construction of and use of a teacher’s weekly record of 
a. Help received 
b. Teacher’s evaluation of the help 
4. A test given the teachers in order to classify them according to 
a. Their educational philosophy 
b. Their conception of its significance as applied to their teaching 
of spelling 
5. A study of the supervisors’ reports to the superintendent regarding 
their activities 
6. The construction and use of a device for 
a. Recording the research agent’s several observations of each 
teacher’s work 
b. Classifying the teaching according to type of pupil-teacher 
activity 
c. Rating the teacher with respect to teaching skill 
Essery has applied numerous statistical techniques, both con- 
ventional and unique, in eliminating or controlling the effects of 
variables other than types of supervisory programs in order to 
arrive at conclusions regarding the relative effects of each super- 
visory program. The many research studies which are sub- 
divisions of the large one are designed to provide control of the 
variables by creating experimental conditions in which one 
variable becomes the significant element to be isolated and 
studied. 


CoNCLUSIONS 


The many investigations included in this and the previous 
chapters indicate the considerable amount of thought and effort 
which has been expended on the evaluation of numerous phases 
of supervision. The present summary of studies shows that very 
marked progress has been made and, in the last decade espe- 
cially, much light has been thrown on the effects of supervision 
and of various types of supervisory officers. The general con- 
clusions which have been drawn from the studies are very briefly 
summarized below. The findings are presented to illustrate the 
types of answers furnished to the three questions raised at the 
beginning of Chapter IV: 


1. The contributions to the growth of children, due to supervision, are 
presented in about thirty research studies, most of which have involved 
experimentation using equivalent groups. In a few questionnaire studies 
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teachers have expressed their belief that supervisory activities have 
materially aided in furthering pupils’ growth. Some twenty-five experi- 
ments involving measurement indicate that significant gains have been 
made in the achievements of pupils taught by supervised teachers. The 
investigations have included testing children’s growth in many of the 
school subjects but especially in the “Three R’s.” Accumulated records 
have been used to disclose other types of desired changes, such as in- 
creased interest in school and school work, regularity of attendance, con- 
tinuation in school, better progress records, and higher standards of living 
outside of school. 

2. Twelve of the studies involving the use of questionnaires, case studies, 
accredited juries, and score cards, and about as many studies involving 
experimentation and measurement, indicate that the effectiveness of super- 
vision on the educational welfare of children has been due to its effect 
on teachers. Frequently teachers have expressed their approval of super- 
vision and indicated what they considered to be the right kind—the kind 
which helped them. Repeatedly they have placed high on the list of 
effective types of supervisory activities demonstration teaching, group 
meetings, personal conferences, and courses of study. Helpful, constructive 
suggestions, constructive criticism, and definite outlines of work, dealing 
with methods, management, subjects, and instructional materials, appeared 
on almost all lists of aids welcomed by the teachers. 

That the approval of such supervision is warranted is to be seen in the 
results obtained in the experiments. Records of changes in teachers’ 
educational interests, professional study, modifications of teaching, and 
the like indicate the effects attributed to programs of supervision in 
operation. Few studies, however, indicate conclusively the improvement 
of teachers due to a specific type of supervisory activity. Some indica- 
tions of the effectiveness of individual conferences, group meetings, and 
demonstrations are to be found in the conclusions, but the amount of 
experimental evidence is small. 

Many complicating factors which are extremely difficult to control in 
experimentation affect the results. Some thirteen questionnaire studies 
and a few experimental ones show clearly the significant part that the 
personality and the philosophy of the supervisor play in any investigation. 
They point with marked agreement to some desirable personal factors 
which should be characteristic of the supervisor who may be expected to 
meet with success in his efforts in so far as his personality becomes a 
serious influence on supervisory results attained. General and specific 
reactions of teachers in their replies to questionnaires disclose that super- 
visors should give encouragement to teachers, be sympathetic, exhibit 
executive ability, be open-minded, codperate with teachers, and exhibit 
tactfulness. 

3. A few questionnaire studies indicate the relative effectiveness of spe- 
cific types of supervisory activities as judged by teachers and by principals. 
Three other investigations involving the use of questionnaires deal specifi- 
cally with the merits of one type of supervisory activity. The small 
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groups of studies furnish little evidence of an irrefutable nature which 
supports the judgment of those replying to the questionnaires. 

Five experimental studies, however, furnish measured results which indi- 
cate the significant contributions of certain supervisory activities to super- 
visory efficiency. One of the investigations shows that a supervisory con- 
ference following a supervisory observation of teaching produces improve- 
ment in teaching which can be clearly seen at the next observation of 
teaching. Another study indicates that the supervisory time devoted to 
personal conferences tends to be more effective than the same amount of 
time devoted to group meetings. Two other investigations involving 
similar research techniques but treating with the supervision of different 
school subjects result in findings which agree markedly. They show the 
relative value of four supervisory programs to be, in descending order, 
as follows: supervision by classes, supervision by schools, inspection of 
schools, and no supervision. The fifth investigation indicates the relative 
values of three programs of supervision, each of which is influenced by a 
specific type of educational philosophy. 


In spite of the research achievements of the many investi- 
gators, most of the irrefutable information needed has yet to be 
obtained. Obviously, little is known, for example, of the value 
of each type of supervisory activity. The relative effectiveness 
of each supervisory technique as compared with every other can 
be determined only by experimentation, which has in reality just 
been well begun. The more complex investigations involving 
the relative effectiveness of (1) combinations of supervisory 
techniques and (2) the order of their use are uncharted fields of 
research. At almost every point in the supervisory procedures 
and programs challenging problems exist which must be solved. 
When all of these researches have been completed, there will 
still be the need for repeating many of the experiments in the 
interest of insuring scientific accuracy and finality of the con- 
clusions reached. 

Although the amount of research to be done in the evaluation 
of supervision far exceeds that which has been completed, the 
extensive experimentation of the past decade presages greater 
research activity in the immediate future. In all probability 
only a short time will elapse before it becomes necessary to 
compile a new summary of research studies dealing with the 
appraisal of supervision. The rapidity with which such sum- 
maries have been appearing is illustrative of the need for fre- 
quent compilations. In the past few years summaries have been 
included in the materials incorporated in two textbooks on 
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educational supervision and in the published literature of two 
professional organizations which are similar to the Department 
of Supervisors and Directors of Instruction.* They indicate, as 
does the present summary, that scientific evaluation of super- 
vision is becoming an actuality. 


*”Gambrill, Bessie L., “A Critical Review of Researches in Supervision.” 
Educational Administration and Supervision, XV (April, 1929), 279-289. (Pre- 
sented at a meeting of the American Educational Research Association.) 

Eighth Yearbook, Department of Superintendence, National Education Asso- 
ciation (1930), Chap. VI. 














CHAPTER VI 


SUMMARY OF PROJECTS INITIATED BY SUPERVISORS 
AND DIRECTORS OF INSTRUCTION 


The purpose of this chapter is to present facts concerning de- 
scriptions of projects which supervisors within various school 
systems have stimulated or caused to be undertaken. In report- 
ing the facts concerning these projects, the committee was aware 
that supervision per se is not the variable which is being 
measured. However, it recognized that one of the most effective 
devices of supervisors for securing improvement of instruction 
is the stimulation of teachers to attempt investigations in which 
effort is made to measure the influence of some variation in 
teaching procedure. While supervision itself is not the variable 
in the investigations conducted by the teachers, the supervisors 
have been responsible for stimulating the experimentation, and 
the results obtained represent in an indirect manner an evalua- 
tion of supervisory methods, devices, and activities. From one 
standpoint, that supervision is most effective which stimulates 
teachers to engage most widely in worthwhile scientifically con- 
trolled experimentation. Thus the members of the committee 
felt justified in devoting a chapter to the analysis and discussion 
of the projects carried on under the direction of the supervisors, 
even though the projects themselves represent studies in which 
method of teaching or learning is the variable rather than the 
nature of supervision itself. 

The contents of this chapter were obtained from question- 
naires sent to all members of the Department of Supervisors 
and Directors of Instruction, i.e., to the membership of your 
own organization. The questionnaires were of two types: one 
asking for a report on investigations undertaken for the purpose 
of evaluating supervision; the other, for a detailed case study 
report of how a supervisor helped an inferior teacher become a 
better teacher. Both questionnaires were in outline form. The 
first questionnaire included the following headings: the purpose 
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of the project, the procedure used in working out the project, 
the results secured, and the evidence upon which the judgment 
of results was based; the second, the nature of the teacher’s 
needs, how the need was discovered, general character of the 
help given, results, and evidences of growth. The nature of the 
many responses seemed to indicate that the type of information 
desired was not clear, even though the first type of question- 
naire was accompanied by a filled inquiry blank setting forth 
for one investigation the exact kinds of data desired. While 
the returns from the questionnaires do not represent all that 
the committee desired, they are valuable in that they provide 
a cross-section of the activities in which supervisors throughout 
the country are engaged and furnish some evidence of improve- 
ment of educational outcomes through activities directed by 
persons in supervisory capacities. 

The data comprising this chapter will be presented in three 
sections: a section dealing with the projects, citing six illus- 
trative projects and presenting the generalization resulting from 
an analysis of purposes, procedures, and methods of evaluation; 
a section presenting two case studies showing how supervisors 
have helped poor teachers become better teachers and giving 
an analysis of all of the case studies reported; and a compila- 
tion listing the names of all individuals reporting projects or case 
studies and certain other data concerning the projects or case 
studies submitted. 


NATURE OF THE PROJECTS 


The purposes of the 77 projects undertaken, as reported by 
the 63 supervisors or directors of instruction, were varied, 
although the greatest number of them involved changes in 
teachers or changes in pupils. In the former type of project, the 
supervisor centered his attention on the teacher with the idea 
of making changes in teaching procedure or technique; in the 
latter type, the supervisor centered his attention on the nature 
of the activities in.which the pupils were participating and made 
efforts to change the nature of the pupils’ responses. With the 
former type of project, the purposes were stated as follows: to 
change a group of Froebellian trained kindergarten teachers 
into a more progressive type; to improve the methods of teach- 
ing the fundamental phases of arithmetic; and to improve the 
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methods of achieving specific outcomes in arithmetic in Grades 
III-VI. The purposes for the other type of project were stated 
somewhat differently: to develop habits of reading good books; 
to present to pupils a world-wide view of ports and commerce; 
to encourage creative ability of the pupils in the social science 
classes of Grades IV, V, and VI; to determine how extensively 
children are using the four methods of subtraction; and to teach 
world friendship to children in the elementary schools. In addi- 
tion to the two types of projects mentioned, other types have 
as their purposes the modification of the curriculum, the estab- 
lishment of improved standards of achievement, the improvement 
of equipment, or the attainment of a series of objectives set up 
by the supervisors. 

In order that the reader may obtain a clearer idea of the 
nature of the activities reported, condensed descriptions of six 
illustrative projects are given. After the presentation of the 
description of these cases, some generalizations based upon a 
tabulation of facts reported follow. 


Project No. 1—TO DETERMINE THE VALUE OF PROOF READING 
AS A MEANS OF IMPROVING THE MECHANICS OF ENGLISH 


Genevieve L. Stone 
Principal, Whittier School, Minneapolis, Minnesota 


Purpose. This project was undertaken for the purpose of measuring, if 
possible, the effects of practice in proof reading upon the child’s ability 
to detect and correct mechanical errors in written English. The project 
was conducted during the 1929-30 school year in Grades IV, V, and VI 
in one building of the Minneapolis Public Schools as a part of a general 
program undertaken throughout the city seeking to stimulate improvement 
in the language habits of the children. 

Procedure. The general method employed in this investigation was to 
determine the status of the children’s achievement in detecting and cor- 
recting mechanical errors in English as given in what may be called a 
pre-test; to stress the proof reading of similar material during two recita- 
tion periods per week for a term of two months; and then to determine 
the status of the children’s achievement on a re-test involving responses 
similar to those demanded by the pre-test. Both the pre-test and the 
test given at the end of the investigation were constructed through the 
coéperation of the principal and teachers of the building. Each of the 
tests was in the form of an interesting and timely letter which each child 
was asked to copy, giving proper attention to the arrangement of the 
parts of the letter, separation of the sentences, punctuation, and capitaliza- 
tion. The task of the child was to detect forty-three different errors 
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which were interspersed through the body of each letter and to correct 
them in copying the material. In order to make clear the nature of the 
exercise involved in the tests and in the practice given, the pre-test is 
reproduced here. 
PRe-TEST 

whittier school minneapolis minn oct 11 1929 dear james i am 

sorry you couldnt be here for my birthday mr r m jones gave me 

a fine copy of black beauty i also received a football a helmet and 

a suit now i can play on jacks team do you think you can be here 

for the game on thanksgiving mother joins in the invitation sin- 

cerely yours john doe 


In order that scoring might be objective, a score sheet listing forty-three 
points to be given consideration were agreed upon. Of these, seven points 
had to do with the arrangement of the parts of the letter; six points, 
with the separation of sentences; fourteen points, with punctuation; and 
sixteen points, with capitalization. 

In the practice exercises during the time the project was under con- 
sideration, effort was made to vary the nature of the exercises in order 
to stimulate interest and avoid indications of monotony. For the sake 
of variety, the teaching exercises were presented on the blackboard, on 
mimeographed sheets, or on a screen by means of lantern slides. Some- 
times exercises which the children placed upon the board before the 
beginning of a session would be utilized. Although the children had been 
informed concerning the purpose of the investigation, the exercises them- 
selves were always spoken of as uncompleted work and never as test 
materials, 

TABLE I 


PERCENTAGE OF ERRORS IN THE DIFFERENT CLASSIFICATIONS THROUGH FAILURE 
oF CHILDREN TO Detecr AND CorREcT THE ERRORS ON THE 
INITIAL AND Finau Tests 














GRADE IVB IVA VB VA VIB VIA 

CLASSIFICATION Ini-| Fr- | Inr-| Fi- | Ini-| Fi- | Inr-| Fi- | Inr-| Fi- | Inr-| Fi- 
OF ERROR TIAL] NAL |TIAL| NAL |TIAL| NAL | TIAL| NAL |TIAL| NAL | TIAL| NAL 
Arrangement ....| 66| 9 | 82} 6] 23) 3/13) 4/]15] 1/)]20] 3 
Sentence sense ...| 78 | 60 27 | 50 |39 | 22) 21 37] 33 | 31 | 23 
Punctuation ..... 49 | 15 | 51 | 20 | 27 |13 | 22 | 12 | 24/17 | 24] 9 
Capitalization ...| 20| 3] 11] 4] 3] 24) 3] 2] 8] 5] 4] 2 
Number of ~~ rr ae ieee = oN Wes ae eet ee Dae eee 
EE +, ca SSeS sie 64 | 60 | 35 | 33 | 38 |36 | 46 | 41 | 78 | 78 | 45 | 43 









































Results. The results obtained from the beginning and the end of the 
investigation are shown in Table I and in the graphs (p. 73). 

From the table and graphs the following conclusions seem to be jus- 
tified : 
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1. That proof reading as a device for improving the mechanics in 
English is effective. All grades, with the exception of Grade VB, made 
considerable improvement on all sections of the test, except capitalization. 
The score of Grade VB on this section of the test was lower on the final 
than on the initial test. Grade VA tended, as a rule, to make relatively 
greater gains than Grade VIB. Subsequent examination of the scores on 
mental tests revealed that many very bright children were enrolled in 
Grade VA and that an unusually large number of children of low men- 
tality were enrolled in Grade VIB. These facts probably account for the 
relatively higher achievement in Grade VA. 

2. That the status of achievement in the sections of the test involving 
capitalization and arrangement was closer to the level of perfection at 
the close of the investigation than the levels of achievement on the other 
sections of the test. 


%Evve I. ARRANGEMENT «II. SENTENCE STRUCTURE 
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3. That the gains made on the sections of the test involving arrange- 
ment, capitalization, and punctuation suggest that instruction on these 
phases of English may well be taught in Grade IV. 

4. That the gains made on the exercises involving the separating of 
sentences suggest the need for additional training in this phase of English. 


Project No. 2-TO DETERMINE THE EFFECTS OF A PROGRAM 
OF SPECIAL TRAINING IN READING 


Heten K. MackintT0osH 
Supervisor Higher Elementary Grades, Grand Rapids, Michigan 


Purpose. This project was undertaken for the purpose of developing read- 
ing skill by means of a remedial program in reading. The project was be- 
gun in the fall of 1929 by the teachers in eighteen elementary schools of 
Grand Rapids, Michigan. The majority of teachers agreed that they 
needed to concentrate mostly on work-type reading, and it was decided to 
use the Gates Reading Test as a basis on which to measure change. 

Procedure. A general plan of procedure was presented to the teachers 
and discussed with them at a meeting held on the third of October, just 
preceding the giving of the Gates test. Following this presentation the 
teachers were asked to list the questions in the field of reading on which 
they wanted help. These questions totaled approximately one hundred 
from all grades and were to be used later in building conferences with 
teachers. 

Principals and teachers were encouraged to plan, in terms of test results 
and their own situations, an organized building program for reading im- 
provement which should have as its chief aim to secure the children’s 
codperation in this program of work-type reading as well as their under- 
standing of what their reading scores on the Gates test meant. The 
teachers were urged to develop daily reading lessons which would stress 
the abilities and skills emphasized in the Gates test but which would not 
duplicate the exercises as to form of organization. Examples of such 
drill materials were displayed and discussed. Principals were urged to 
make use of the suggestions in Gates’ The Improvement of Reading. 

Small group conferences were held at which teachers were helped to 
analyze the test results in each individual classroom. Following these 
conferences each building was supplied with a set of the McCall-Crabbs 
Standard Test Lessons in Reading, Book III, which emphasized the skills 
involved in the Gates, Type D, test. This material was used once a week 
for a period of ten weeks. 

There was much variation in the remedial work undertaken by the 
teachers. One teacher organized a program in which she adapted her 
drill to the need shown by the results on the Gates reading tests. On 
Monday she selected pupils making low scores on Type A and gave them 
drill on exercises of similar type. On Tuesday she selected pupils mak- 
ing low scores on Type B, and gave drill accordingly. She continued this 
process throughout the four tests, and on Friday gave a general drill on 
all types. 
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Another of the teachers in this group carried on an intensive study on 
an experimental basis. In terms of the October results of the Gates tests, 
she arranged to compare her students with a control group in a nearby 
school matched by grade and mental age and receiving only regular 
reading instruction. 

The Gates Reading Test was used for determining the value of the 
remedial program. In the final evaluation the results from the eighteen 
schools were handled as a group and no effort was made to determine the 
effects achieved by individual teachers. 

Results. Tables II, III, IV, and V present the results of the Gates Read- 
ing Test as given by the October, 1929, and May, 1930, testings. 


TABLE II 


GRADE-LEVEL EQUIVALENTS OF THE Composite Scores ATTAINED ON THE 
Gates Reaping Test BY THE Pupits 1n Grapes III-VI or E1cHTeen 
ELEMENTARY ScHoots or GraNp Rapips, Ocroser, 1929 











@uste Ran jan oF GRADE-LEVEL —— 
3-1 0-10 32 L 32 
3-2 0-9.5 3.5* 37 
4-1 0-108 44 42 
4-2 21-113 48 47 
5-1 22-119 58 52 
5-2 3.1-12.0 6.0 5.7 
6-1 29-115 7.0 6.2 
6-2 35-116 72 67 














* Below Standard. 
TABLE III 
GRADE-LEVEL EQUIVALENTS OF THE ScorES ATTAINED ON THE Various Spc- 
TIONS OF THE Gates Reapina Test BY THE Pupits IN GRADES 
III-VI or EigHTeeN ELBMENTARY ScHOOLS or GRAND 
Rapips, Ocroser, 1929 














GRADE-LEVEL 
GRaDE 
TyppA Tyre B TyPeC Type D 
3-1 3.4 3.2 3.3 3.0* 
3-2 3.6* 3.6* 3.7 3.3* 
4-1 46 42 47 4.0* 
4-2 5.1 52 5.5 4.3* 
5-1 §.1 62 6.3 4.9* 
5-2 6.0 6.3 6.0 5.0* 
6-1 68 77 6.9 5.6* 
6-2 6.9 8.0 78 6.0* 

















* Below Standard. 
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From Table II it might be judged that the average pupil was standard 
or above standard in general reading ability at the beginning of the 
project. However, when grade-levels for the four different parts of the 


test were secured separately, it became evident that children needed 


further experience with skills involved in the Type D test, “Reading to 
Note Details.” 


GRADE-LEVEL EQUIVALENTS OF THE CoMposiTE Scores ATTAINED ON THE 


TABLE IV 


Gates Reapinac Test BY THE Pupits IN Grapes III-VI or 


Ocroser, 1929, anp May, 1930 


EIGHTEEN ELEMENTARY ScHOOLS OF GRAND Rapips, 






































GRADE emer GRADE-LEVEL — “~ wid 
OCTOBER May OCTOBER May OCTOBER May OcTOBER May 
3-1 3-2 0-10 1.2-11.2 3.2 41 3.2 38 
3-2 4-1 095 | 20-110 3.5* 43 3.7 43 
4-1 4-2 0-10.8 | 2.9-11.5 4.4 5.3 42 48 
42 5-1 | 2.1-11.3 | 28-11. 48 59 47 5.3 
5-1 5-2 2.2-11.9 | 36-11.9 58 69 5.2 58 
5-2 6-1 3.1-12.0 | 3.2-116 60 74 5.7 6.3 
6-1 6-2 2.9-11.5 | 35-118 7.0 83 6.2 68 
6-2 7-1 3.5-116 | 3.7-116 72 8.7 6.7 73 
* Below Standard. 
TABLE V 


GRADE-LEVEL EQuIVALENTS OF THE Scores ATTAINED ON Type D oF THE 


Gates Reaping Test By THE Pupits 1N Grade III-VI or 
EIGHTEEN ELBMENTARY SCHOOLS oF GRAND Rapips, 
Ocroser, 1929, anp May, 1930 














GRADE STANDARDS Type D 
OcTOBER May OcTOBER May OcTOBER May 
3-1 3-2 3.0* 4.1 3.2 3.8 
3-2 4+1 3.3* 4.2* 3.7 43 
4-1 4-2 4.0* 4.5* 4.2 48 
4-2 5-1 4.3* 4.8* 47 5.3 
5-1 5-2 4.9* 6.2 5.2 58 
5-2 6-1 5.0* 66 5.7 6.3 
6-1 6-2 5.6* 68 6.2 68 
6-2 7-1 6.0* 9.5 6.7 7.3 




















* Below Standard. 


As a summary of the work of the year, the reading group prepared a 
bulletin of lessons actually taught by teachers in which the relation of 
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reading to geography, history, civics, arithmetic, nature study, and other 
subject-matter fields was shown. In addition, this group sponsored the 
use of mimeographed book lists for summer vacation reading and each 
child received his own copy of the list, which he is to bring to the Book 
Party in the fall. By comparing their own medians with the median 
for the whole city, the group which has concentrated on reading was able 
to conclude that an organized program for the improvement of reading 
had made possible decided gains. 

Teachers who participated in this project have been awakened to a 
keener sense of the need for developing specific skills in work-type reading 
as a means of eliminating specific weaknesses in reading, and they have 
seen the value of taking children into their confidence in setting up goals 
of attainment and in all remedial training exercises. 


Project No. 3-TO COMPARE THE RESULTS OBTAINED BY 
THREE DIFFERENT METHODS OF CONDUCTING CLASS 
WORK IN ARITHMETIC IN GRADES III AND IV 


Anna Ryss 
Supervising Teacher, Winnebago County, Wisconsin 


Purpose. This investigation was undertaken to determine, if possible, 
which of three plans offered in the new course of study issued by the 
State Department of Public Instruction for 1929 for conducting a com- 
bination of Grades III and IV for instruction in arithmetic in the rural 
schools was most satisfactory. The condition underlying the offering of 
these plans grew out of the fact that Grades III and IV in the rural 
schools recite the work for all subjects together. According to the pre- 
vious suggestions, the arithmetic for Grade III is offered in the odd 
numbered years and that for Grade IV in the even numbered years. 
Since great difficulty had been experienced by the pupils in Grade III 
in the years when the subject matter for Grade IV was being offered, 
the State Department made a new ruling offering the following alterna- 
tives: 

Plan I. The recitation for each grade may be alternated with drill and 
practice exercises. On alternate days the teacher may devote the class 
time to developing new subject matter or new skills with the pupils of 
Grade III. Grade IV may be assigned drill work using work books or 
other drill materials. On the intermediate days, the teacher may give 
her attention to the pupils of Grade IV, while the children of Grade III 
work independently on practice exercises. 

The large amount of scientifically prepared drill material which is now 
available offers an opportunity for valuable practice without immediate 
supervision by the teacher. The drill work should be selected to meet 
the needs of each individual child. 

Plan II. It is easily possible, with modern textbooks, and may be 
desirable to individualize the work of these grades. The modern arith- 
metic books give excellent study instructions, good practice materials, 
valuable diagnostic and progress tests which may readily be used to guide 
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each individual child in his work. This makes individualization of work 
very practicable. 

Plan III. Each class may be assigned ten minutes of the twenty min- 
utes assigned for the combined grades on the program. 

Procedure. In the attempt to determine the most effective plan, the 
schools of the county were divided into three groups. Group I used 
Plan I as outlined in the course of study; Group II, Plan II; and Group 
III, Plan III. In dividing the schools into these groups, no thought was 
given to the teaching personnel or to the enrollment of the schools. The 
only thought in mind was to divide the county into three sections so 
that there would be a fairly equal distribution of schools, with those of 
any one group in close proximity. During the period of the investigation, 
ie., from the last week in October to the last week in May, the teachers 
in the different groups planned their work according to six weeks’ outlines 
regularly sent out from the office of the State Superintendent. These 
outlines indicated merely the work to be covered during the period of six 
weeks, without giving suggestions for teaching them according to the dif- 
ferent plans. The supervision of instruction in these grades was the same 
as in previous years. The supervisor gave no special attention to a school 
unless the teacher of the school requested aid. The supervisors did, how- 
ever, exercise care to see that the amount of supervision among the three 
groups was approximately equal. The Woody-McCall Mixed Fundamen- 
tals in Arithmetic Test was the instrument used for determining the 
effectiveness of the three plans of instruction. Form I of this test was 
given during the last week of October; Form II, during the last week of 
April. The amount of gain made, represented by the difference between 
the October and May scores, was taken as an index of the relative 
effectiveness of the three plans in organizing class work. 

Results. Table VI, exhibiting the data concerning the number of schools 
and pupils in each group of schools, together with the median scores 
attained and the relative amounts of gain made, indicates that the best 
results were achieved by the pupils instructed according to Plan Il—that 
plan which emphasized individualized instruction. 


TABLE VI 


NuMBER oF SCHOOLS AND PUPILS IN THE THREE Groups or SCHOOLS AND 
THE ReLativE AMouNTS oF GAIN Mapp By THE Pvuplits IN 
EacoH Group or ScHoois 

















ITEM Group I Group II | Group III 
Number of schools in groups.......... 28 30 29 
Number of pupils in groups........... 124 138 94 
Median score for October (1929)....... 9 8 9 
Median score for May (1930).......... 14 15 14 
GR A SII 5 seis bs oe vt lv'cncoa ss sie 5 7 5 
Gain in percentage of October median. 55.5 87.5 55.5 
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Project No. 4-TO DETERMINE THE VALUE IN TEACHER 
TRAINING OF DEMONSTRATION LESSONS IN ADAPT- 
ING INSTRUCTION TO THE NEEDS OF PUPILS 


May E. Byrn 
Director of Special Education, Minneapolis, Minnesota 


Problem. To measure the value of the demonstration lesson as a device 
for showing teachers in service how to adapt instruction to the needs of 
pupils. 

This problem arose in connection with the attempt of the super- 
visors and teachers of special classes for retarded children in Minneapolis 
to base academic training upon units of work taken from the social 
studies. Five difficulties were apparent in connection with the successful 
accomplishment of this task: homogeneous grouping of pupils; adapting 
material to different levels of ability; providing adequately for individual 
differences; organizing the work to cover a given period of time; and 
tying up two or more units of work. The supervisor was conscious of 
the difficulties encountered by teachers and attempted to help them by 
giving, at the beginning of the school year, a series of demonstration 
lessons showing how to meet some of the enumerated difficulties. Selected 
groups of special teachers and their principals were invited to attend. 
After the presentation of the lessons, those present discussed them from 
various points of view and made an evaluation of the worth of the 
demonstration. 

Procedure. Each of the demonstration lessons was given at the close 
of a period of two weeks, during which a classroom teacher worked with 
the children. Transportation, one of the units of work in the social 
studies course of study, was chosen for the first demonstration lesson. 
Since land transportation was of greater local interest and more accessible 
than either water or air transportation, it was chosen to be the center 
of interest. Enthusiasm for the topic was encouraged by such questions 
as: What things must we have in order to live? How are they carried 
to us? In this manner the ideas of the means of transportation were 
developed. 

During the two weeks before the demonstration lesson was to 
be taught, the class took various excursions. It so happened that, at 
the time the unit in transportation was under consideration, the first 
blimp visited Minneapolis. The coming of the blimp, even though more 
directly concerned with air transportation, was seized upon as a means 
of stimulating an interest in transportation in general and the class was 
taken to the flying field at Fort Snelling. Groups A and B visited a 
trolley and a bus station. They also went to the public library for the 
purpose of selecting reference materials. The entire class visited the Great 
Northern Railway Station. They were taken aboard a train, visited the 
diner, the sleeping coach, parlor car, and observed the engine and other 
parts of the train. They visited the baggage room, the ticket office, the 
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check room, and the information desk. They talked with a representative 
of the Travelers’ Aid Society and learned of the work done by this 
agency. 

Thus during this period of two weeks the children had many experiences 
in connection with the topic of transportation. 

At the close of these two weeks in which the children had been gaining 
their meaningful experiences, the first demonstration lesson was given. 
In the first lesson the supervisor aimed to cover three points: how to 
divide a class into homogeneous groups on the basis of achievement, 
mental age, and social fitness; how a center of interest may be adapted 
to different levels of ability; how to provide for individual differences. 
To demonstrate the first point, the supervisor presented results of a battery 
of tests, including the Gates Silent Reading Test, the Woody-McCall 
Mixed Fundamentals in Arithmetic Test, and a spelling test. She then 
discussed the past achievement of the children, their mental ages and 
their social fitness, and indicated the parts which these items should play 
in the scheme of grouping. After discussing the method of grouping, the 
supervisor taught the lesson, trying to adapt her instruction in such 
manner that she would demonstrate to the teachers and principals the 
best method of accomplishing the points that she had designated. At 
every point in the demonstration the experiences which the children had 
gained during the previous two weeks were utilized. 

Results. In order to determine the value of the demonstration lessons, 
the Director of Special Education sent a questionnaire to fifty-three 
teachers who had just witnessed such a lesson and asked them to give 
their candid opinions concerning the helpfulness of the lesson. All fifty- 
three teachers who saw the demonstration sent replies, and fifty-one 
teachers stated that the lesson had been helpful; two teachers stated 
that it had not been helpful. One of the latter stated that she felt dis- 
couraged after seeing the lesson; the other, that she felt that centering 
all activity in her group around one activity would prove uninteresting 
to the group. 

Among the values included among the answers attesting to the value 
of the lessons are the following: 


Increased my self-confidence 

. Showed me new ideas of organization 

Made me more alert to real situations 

. Showed me how to adapt materials to the needs of the group 
. Stimulated me to think of activities for my class 

Showed me how to correlate activities with a center of interest 
. Gained idea of activities for a group with low mentality 

. Gave me a better idea of grouping 

Made me realize the need for careful planning 

Helped me see the possibilities in my own pupils 

. Showed me how to provide for individual differences 


HK SOODNAONRWN 


— 


After receipts of this type of evidence, those who had been responsible 
for the demonstration teaching felt that it had made a contribution to 
the program for teacher training. 
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Project No. 5-TO MEASURE THE INFLUENCE OF A PROGRAM 
OF SPECIAL EMPHASIS ON READING 


A. U. JenxKINS 
Principal, South Eighth Street School, Newark, New Jersey 


Purpose. This project was undertaken for the purpose of measuring the 
influence of a program of special emphasis on reading. Classroom obser- 
vation had shown an over-emphasis upon one phase of reading—that of 
oral reading—with little attention being given to the technique of teach- 
ing. There was a lack of familiarity with commonly accepted objectives 
of reading and a complacency toward the methods used and the results 
achieved. A survey of several grades through the use of standardized 
tests had shown the grade norms for the school to be much below standard. 

Procedure. The results of the survey were placed before the teachers 
at a teachers’ meeting. The suggestion was made that the emphasis had 
been on oral reading to the neglect of other types. Plans for remedial 
measures were formulated immediately. A short bibliography of selected 
books and articles was made available. Bulletins on the aims and methods 
of silent and oral reading were prepared by the principal. Visitation was 
arranged to places in which newer types of reading were emphasized. 
Lessons were observed, criticized, and discussed upon invitation of the 
teacher. Objectives and methods were discussed with individual teachers 
and a series of teachers’ meetings for further discussion of the problem 
was conducted. Attention was directed to the reading technique as 
related to all other school subjects. An extensive use of the library service 
wags encouraged. 

Practically all teachers began to study the books recommended and 
practices required for the newer types of instruction. Findings of indi- 
vidual teachers were reported at teachers’ meetings; several teachers 
enrolled in special courses in reading approved by the principal, which 
emphasized a need for surrounding children with numerous reading ap- 
proaches in natural situations; new principles began to be incorporated 
into school practices; materials for experimental work were placed in the 
classrooms. The teachers came to recognize reading as a tool for com- 
plete living within a group and became interested in reporting their 
experiences and findings for discussion in teachers’ meetings. 

Results. Table VII shows the improvement in class efficiency which took 
place almost immediately when the shift in emphasis from oral to silent 
reading was made. The Monroe Silent Reading Test and the Detroit 
Reading Test were used to measure the effect of this program of special 
training. The Monroe test, given in March and June, 1928, and the 
Detroit test, given in November, 1928, and January, 1929, showed the 
immediate effects of the training; a repetition of both these tests in 
April, 1930, was used to measure the permanent effects. The results of 
the test given on April 9, 1930, show that the improvement in silent 
reading was maintained, although no emphasis had been placed upon the 
subject of reading by the principal for more than a year. 
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TABLE VII 
Mepian Scores 1N Rate AND COMPREHENSION SHOWING IMPROVEMENT ON 
Monroe STanparDIzeD SmteNT Reapina Test FROM Marcu, 
1928, ro Aprit, 1930, rv Grapes III, IV, anp V or 
THE Newark Pustiic ScHoois 














STANDARD SCORES MARCH, 1928 JUNE, 1928 APRIL, 1930 
GRADB 
COMPRE-| Rarp |COMPRE-} Raryp |COMPRE-| Raggy |COMPRE-| Rarp 
HENSION HENSION HENSION HENSION 
IIIB 38 82 3 74* 3 72 
IIIB 38 82 7 99* 6 95 
TIA 38 82 5 85* 7 94 
IIIA 38 82 7 117 
IVB 7.7 122 5 82 8 140 6.6 109 
IVB aa 122 9 127 
IVA 7.7 122 6 97 9 150 7 127 
IVA 7.7 122 10.5 140 
VB 98 142 7 100 10 142 10 149 
VB 98 142 85 130 12 185 
VA 98 142 7 93 11 140 9 114 
VA 98 142 12 151 





























Blank spaces indicate no test given or no class organized. 

* Tested November 19, 1928. 

Table VIII shows the improvement in efficiency as indicated by the 
Detroit Reading Test. In the testings of November, 1928, and January, 
1929, Grades V and VIII were not tested with the Detroit test. “Attempts” 
for these testings were also not recorded. 

Upon analysis of Table VIII, it is found that the scores under date of 
April 9, 1930, in Grades VIIA, VIIIB, and VIIIA, do not compare favor- 
ably with the standard scores. A changing population was offered as 
an explanation of this situation, but, upon careful checking of the scores 
made by individual pupils in the preceding test, it was found that the 
skills achieved in the earlier grades were not satisfactorily maintained. 
These results, while unsatisfactory, set the problem for a careful and com- 
prehensive study of the reading situation in Grades VII and VIII for the 
coming term. At the present writing, much reading, discussion, and 
analysis have taken place, but an actual measurement of results has not 
yet been made. 


Project No. 6-TO DETERMINE THE EFFECT ON DISCIPLINE 
OF AN EDUCATIONAL PROGRAM EMPHASIZING 
THE PUPILS’ CREATIVE ATTAINMENT 


Warren A. Rog 
Principal, Belmont Avenue School, Newark, New Jersey 


Problem. The purpose of this project was to determine whether the 
creative possibilities of the “unit of work” concept could be developed 
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TABLE VIII 
Men1An Scores IN COMPREHENSION SHOWING IMPROVEMENT ON THE DerroiT 
Reapine Test rroM Novemser 19, 1928, ro Aprin 9, 1930, 1v GRADES 
V, VI, VII, ann VIII or tHe Newark Pusuic ScuHoors 























STANDARD Scores | NOVEMBER, 1928 | JANUARY, 1929 APRIL, 1930 
GRADE 
RIGHTS udiives RIGHTS oda RIGHTS A RIGHTS a 
VB 9 14 14 18 
VB 11 16 13 18 
VA 11 16 17.5 21.5 
VA 11 16 18 22 
VIB 13 17 13 19 17 22 
VIB 13 17 16 19 18 20 
VIA 15 18 10 125 12 16 
VIA 15 18 17.5 18 17 20 
VIIB 10 14 9 13 11 15 
VIIB 10 14 9.5 9 14 16 
VIIA 12 15 9.5 12 9 12 
VIIA 12 15 11 12 12 16 
VIIIB 14 16 9 12.5 
VIIIB 14 16 14 16 
VIIA 17 22 12 16 
VITIIA 17 22 16 18 




















with reasonable success in a large city with pupils of low type, with an 
unselected teaching staff, and without special appropriation and equip- 
ment. 

Procedure. The supervisory activities aimed to develop the scientific 
attitude toward current movements in educational philosophy and to 
encourage teachers to experiment with various individual instruction plans 
and other methods of teaching in the elementary schools. Various sugges- 
tions were given through group conferences, provision of opportunities for 
studying professional literature, special consultants secured from nearby 
colleges, etc. 

Results. That worthwhile results were secured was evidenced by the 
fact that records show a seventy-five per cent reduction in the number 
of disciplinary problems; that the largest summer school enrollment in 
the history of the school occurred the following summer; that visitors, 
well acquainted with the situation and well qualified to judge, commented 
favorably upon the improvement in the general atmosphere of the school 
and the activities of both teachers and pupils. 


The presentation of these six illustrations gives some idea of 
the nature of the projects stimulated by supervisors. A few 
facts concerning the remaining projects may be obtained from 
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the summary table at the end of this chapter, which gives the 
name of the person reporting the project, the purpose of the 
project, the procedure followed, and the evidence used in judging 
the results. 

Table IX, summarizing the various procedures involved in 
directing the supervisory initiated projects reported to the com- 
mittee, indicates that supervisors are using an objective testing 
program combined with group discussions and individual con- 
ferences as the chief means of stimulating teachers to experi- 
mental activity. Demonstration teaching, bulletin supervision, 
and other procedures are incorporated in the supervisory pro- 
grams much less frequently. However, since there were only 77 
individual projects reported and 126 different procedures listed, 
it is apparent that supervisors do not rely upon one technique 
solely in stimulating and guiding teachers in efforts along new 
lines of educational procedure. 


TABLE IX 
Procepures Usep 1n Directina Proyecrs 











PROCEDURE FREQUENCY 


Direction of objective, diagnostic testing program........... 41 
Discussion in group meetings..................cc cece eeeeeee 
Conferences with individual teachers...................00005 
Special equipment provided....................ccceeeee cece | 
Secured help of outside specialists.....................00055 
Demonstration teaching ...........ccecccsccrcececcccveves 
Direction of teachers’ reading and study.....................- 
Suggestions given through bulletins.......................0. 
Exhibition of work and projects.................0ceeeeeeees 
Set-up of objectives and standards.....................0000- 
QRSARINNG DOBEION I OUIIE iio ooi oo 6.0.0.6. 6.50:00 sivivsivccceneessoereses 
Used questionnaire method................. 0c eee ee cece eens 
Collected teacher problems..................00ceceeeeceeees 
Reorganized teaching technique..................0.cceeeeues 
Secured stenographic reports of lessons.................00005 
Ee ee a ee ee ee a 
Reported similar projects...........ccccseccccesccsccccceces 
Published results of projects...............c0cccceeeeeceuces 
ORRRTIEOR BHURY CINMIOB S605 6 scvivcccecuicescsanccesscveceevcece 
Reorganized class programs..................eccceeceeuceees 


— dS 
a 


—— DWH N DN WA ®~10 0 





Total Number of Projects. ....6.5 6.0.0 csceeccccsdcccvcvees - 126 
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There is no available information in the reported data to aid 
in determining which of the various procedures involved secured 
the most satisfactory results. Such an investigation would be 
of very definite value in the problem of evaluating supervisory 


techniques. 
TABLE X 


TpcHNiques Usep ror EvaALuaTION oF Projects 











TECHNIQUES FREQUENCY 
Se GERRY CPE CECE C OTOP CREE COCL CLT OPCET 47 
Opinion of GiperViOr OF PFIMGIPAl,. 626.0 cvsccrccsccecconcs 13 
OUR SGI GRUNER 6 5 o5.c0cascacsnccesvicwacecaddenoccse 13 


Improved teacher attitude as shown through desire for super- 

vision, codperation, advanced study, etc.................6- 
COIR GE AAI ss din tchnae dannciebudaawesadce Saun NeceiKele 
Increase in number of books read by children................ 
Cimee 1 UOROREER COCIIGIIGS 66 6 6 500 cn cvcacvcccccscce descents 
Opinion of parents and people of community................ 
Increase in demand and expenditures for materials........... 
Improvement shown by school marks......................- 
Decrease in overageness and retardation..................8 
Examination of teachers’ lesson plans 
Decrease in discipline problems...................200eeeeee: 
Increase in summer school enrollment 


_ 


—— = oo mm AIT 00 00S 


ee 


3 
°o 

co 
z. 
— 
8 








Table X lists the various means used by supervisors in evalu- 
ating the results obtained in projects reported. In approximately 
one-third of the cases, the results were measured by the use of 
test data or other objective evidence. In a large number of 
cases the evaluations were made on the basis of the judgment 
of supervisors, principals, teachers, or others interested in the 
experiment. It is apparent, however, that in the evaluation of 
the results from many of the projects both types of evidence 
were considered by the supervisors concerned. Undoubtedly 
both forms of evidence are of definite value in estimating the 
worth of an educational procedure and the use of each type may 
be justified in a supervisory program. 


Case Stupies SHOWING HELP Given INDIVIDUAL TEACHERS 


The committee, in connection with the discussion of the 
evaluation of results achieved through the different projects, felt 
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that it might be helpful to supervisors to present a few descrip- 
tions of how supervisors have helped poor teachers become better 
teachers. The committee was especially interested in having 
these descriptions emphasize three things: a detailed description 
of the work and attitude of the teacher before any supervision 
was given; a detailed description of the remedial suggestions 
given; and a detailed description of the teacher’s work after 
supervision. In connection with the detailed description before 
and after supervision, the committee was desirous of having the 
presentation of as much objective data as possible, in order that 
it might be used as the basis for determining the influence of 
the remedial suggestions given. 

A canvass of the membership of the Department of Super- 
visors and Directors of Instruction resulted in the reporting of 
several interesting case studies indicating how supervisors had 
helped particular teachers. In most of the studies the descrip- 
tions were rather brief and often data needed for objective 
evaluation were omitted, but all of them indicated the nature 
of the help which supervisors offered in their attempts at im- 
proving the situations. Since it is impossible to include all of 
the case studies reported, condensed summaries of two studies 
emphasizing different types of supervisory problems are repro- 
duced. The first study describes how a supervisor stimulated 
a teacher to demand higher standards of work from her pupils; 
the second, how a supervisor improved a teacher’s morale and 
teaching technique. After the presentation of the case studies, 
a few summaries made from the case study reports will be given. 


Case No. 1—STIMULATING A TEACHER TO DEMAND HIGHER 
STANDARDS OF WORK 


Auta McIntire 
Berwyn, Illinois 


Nature of teacher's needs. This teacher seemed to have little idea of 
the quality of work of which children were capable if sufficiently guided 
and motivated. Her standards of possible outcomes were low and she 
constantly accepted, as satisfactory, work from the children which might 
easily have been done with much better results. 

How discovered and diagnosed. This lack of adequate standards was 
discovered through visits to the classroom; the examination of children’s 
work and comparison with the results of other children’s activities; and 
the results obtained on objective tests. There was every indication that 
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the children were not being held to the efforts of which they were fully 
capable. 

General character of help given. During a personal conference the 
supervisor examined, with the teacher, some of the children’s papers in 
which careless work was very apparent. Lessons that had been observed 
were discussed, and instances where poor work was accepted were pointed 
out. Opportunity was provided for visitation to strong teachers who 
maintained high standards of work. The supervisor gave demonstration 
lessons and emphasized the value of careful effort. In various other ways 
the supervisor endeavored to lead the teacher to an appreciation of the 
remarkable capacity of children when stimulated and encouraged to put 
forth their entire effort. 

Results in terms of teacher or pupil growth. Previous to this super- 
visory campaign this teacher had been rated “C” by each of three super- 
visors. At the close of the period of intensive training, each supervisor 
again visited the teacher and classified her teaching skill with a “B” rating. 
Scores obtained by the children on both standardized and informal tests 
were appreciably higher, indicating that better teaching techniques and 
more stimulating types of motivation had been employed. 

What, in general, were the evidences of such growth? The children 
were markedly more alert, interested, active, and eager to do their best. 
Frequently, work was ‘done over which would previously have been ac- 
cepted by the teacher without comment. The children were engaged in 
much more constructive activity and the concrete results were of very 
satisfactory quality. The schoolroom, which had previously been untidy 
and uninviting, was neat and attractive and the general atmosphere of 
the room was more spontaneous and more cheerful. 


Case No. 2—SUPERVISORY HELP GIVEN TO A TEACHER 


Leone E. Perers 
Principal, Eugene Field School, Minneapolis, Minnesota 


Nature of teacher's needs. The teacher to be aided had taught in the 
Minneapolis school system one year and then had left to teach in a mission 
school. After one year there she returned to resume her work. During 
the first year her work had proved successful under the skillful supervision 
of the Supervisor for New Teachers. Upon her return, however, she was 
placed in a different school. Adjustment then seemed difficult for her, 
with the result that her work did not meet the required standard. Dur- 
ing the past year she was transferred again in the hope that a new 
environment would stimulate her to better effort. In this school it was 
found that her vision was limited, her attitude undesirable, and that her 
teaching approaches did not challenge the pupils. She showed lack of 
organization and appreciation of the interests and abilities of children 
and was therefore unable to develop good habits of work on the part 
of the pupils. 

How discovered and diagnosed. During the second week of her work 
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it was discovered that this teacher lacked standards and that the planning 
of her work was inadequate. She left the building soon after dismissal 
in the afternoon, with no definite plan of work for the next day. She 
did not seem to realize the importance of definite and specific planning 
of subject matter. The classroom was neither attractive nor pleasant for 
the pupils. The teacher seemed to have an inferiority complex due to 
low ratings by previous principals. Her work lacked motivation. Dis- 
cipline problems developed. 

General character of help given. The first step in helping this teacher 
after visiting her room for two weeks was to discuss in conference certain 
general matters relating to the work. She was extremely nervous and 
related how unhappy she had been in previous buildings. The first 
attempt was to get the teacher to feel that the principal was there to help 
her. He visited her two or three times a week and after each visit con- 
ferences were held with her, noting the good points and the points needing 
improvement. She was given an opportunity to observe other teachers 
in the building. As she was teaching in Grade IIB, certain basic prin- 
ciples in primary reading method were emphasized. At appropriate times 
the following topics were discussed: (1) the organization of the classroom; 
(2) ways of establishing good habits of work; (3) lesson plans; (4) appear- 
ance of blackboards; (5) neatness of written assignments on boards; 
(6) charts for motivation; (7) teaching procedures; (8) checking plans 
in plan book each week; (9) technique used to take care of individual 
differences; (10) materials to be used for remedial work. The entire first 
term was spent in trying to get this teacher to gain confidence in herself 
and to improve her teaching technique. 

Results in terms of teacher or pupil growth. A new class in Grade IIB 
was given her the second term and before work was begun the weak- 
nesses of the past term were discussed with her by the principal. She was 
sent to visit for one-half day and returned full of enthusiasm for her 
work. This second term has given her much confidence to go ahead. She 
has established excellent habits with her pupils and has shown great 
improvement in her work; she herself realizes the results obtained by 
systematic planning; she has developed standards and has secured the 
pupils’ interest in their work; she has developed among her pupils a sense 
of responsibility which was lacking the first term. 

What, in general, were the evidences of such growth? The evidences 
of her growth were as follows: (1) restored confidence in herself; (2) 
changed attitude toward her work, her pupils, and those in supervisory 
positions; (3) growth in the technique of teaching; (4) better understand- 
ing of the principles underlying good teaching seneigee (5) happiness 
which comes from success. 


Some additional impressions may be gained from generaliza- 
tions based upon an attempted analysis of the data provided in 
the descriptions of the case studies reported. Table XI, indicat- 
ing an attempted summary of the types of needs by the teachers 
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NATURE OF THE Neeps oF TEACHERS AS REPORTED IN THE Case STUDIES 








NEED 


FREQUENCY 





Help in developing desirable reading habits.................. 
Help in adjusting to new techniques and methods............ 
Knowledge of individual differences and personalities........ 
BION TEE MN hcids bdlacne a daedn cveeiasidnavevdenseocvar 
Encouragement and confidence 
Help in general management 

Help in teaching arithmetic 

Help in organizing “activity programs”................0e00- 
Help in setting up desirable standards....................-- 
Help mm teaching Social G6Udi16S. ....6.. 606 c ccc ccccccscccssccce 
Help in caring for speech defects... ..........sccccccccevcces 
Help in developing general teaching skills 
Fie. 1: DARGNBS, GIOW QLOUDE «6c oc cc ccccsiccnceecsivssescces 
Help in motivating work for problem children 


Total needs 





a Oe 


w 
J 





under consideration, shows that the difficulties encountered by 
teachers are of various types. However, all needs center, more 


or less, around some phase of classroom procedure, su 


ch as im- 


proved ways of teaching reading, arithmetic, or the social studies, 


or adjustment to methods or techniques of teaching. 


TABLE XII 
Tue Meruop or DiscoverING THE TEACHER’s NEED 











METHOD FREQUENCY 

Observation of teacher's WOPrk «..0ccccccccccccecssssccesvces 21 
PTE Gr NE OIE bo ove vivnsiacnnornnewnaxdwedxe 10 
CAE WR TORING 05 oo wo i ne dies Hehe Sat bdeewueudes 7 
RN SETI ic oo iva Se Sree eet Skee eseceetciis 5 
Ie Gr OA ON ee adire aie sated wenia cee cuemeenens 1 
Analysis of pupila’ written Work... 0... ccccccccesccccscesss 1 
OE, CE PRION 5550 560i sa clanenis niv'edand<eewelanseacnse 1 

WS ee ree 47 








Table XII indicates that supervisors discovered approximately 


50 per cent of the needs involved in connection wit 


h the re- 


ported case studies through observation of the teacher at work. 
The use of standardized tests was the second most frequently 
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reported means of discovering the needs of the teacher. Dis- 
covery of needs through conference with teacher or through the 
teacher’s request for aid were reported relatively infrequently. 

While observation of the teacher at work was mentioned most 
frequently as the means for discovering the needs of the teachers, 
it seems advisable to question whether this is the best or most 
economical method of detecting the difficulties encountered. No 
report was made concerning the amount of time devoted to such 
observation before locating the obstacle to success. If it were 
possible to locate the difficulties through inquiry blanks, a col- 
lection of teachers’ statements of difficulties, or through personal 
conferences, it is suggested that a more economical procedure 
might be inaugurated. 











TABLE XIII 
Means Emptoyep By Supervisors ror Amina TEACHERS CONCERNED 
MEANS OF HELPING FREQUENCY 
Suggestions through conferences ..............seeseeeeeecees 19 
Suggestions for professional reading............ssseeeeeeeees 13 
ROGAN INE og 55:5 vind nays 5 04.0. 0 ode oUele See ween ales 11 
ASIN ENNIS os vices 9 0:5 cade sine a ess ssenonsasoeawsese 10 
WISAMIAIRONG Lt ID: os close ch bass eHideceeeeseesutveesees 7 


Codperative-analysis of results........csccseccccceccecccccce 5 
Wy UCT NNN 5 515055: 5:9. 4.a15 6S HA ONGC eS eb oR Hae Ua Cots 4 
PAN I sion wx. cacackouSrdoahectacerSiwncsas anew 3 
MEARS IROUAUAOND:. 5 0:56: devs wi eiclnikcoin So's .0i0'e.9'o ase are msioninos’e. 3 
Provided conferences with specialist............eeeeeeeeeeees 1 
Changed teacher to another building and grade.............. 1 
Betottp GOGERer COMIPCUEION, o.2.0.0.6:0.0:0:056:004.05 sevens on s.cssinve 1 


TOU SURROMIONS TOPOHION .. 5.6.0 ic cca science Seeevereeeesesen 78 








From Table XIII it is evident that supervisors used various 
methods of aiding the teachers. The individual conference was 
most often reported as the means of conveying supervisory sug- 
gestions to the teacher. Other frequently mentioned methods 
were: guidance of the teacher’s professional reading, demonstra- 
tion teaching, and codperative planning. 

Increased interest among pupils and teachers, as indicated in 
Table XIV, was reported most often as the basis upon which the 
supervisor judged the influence of the supervisory suggestions 
given. 
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TABLE XIV 
Evipence Inpicatina Teacher GrowTH RESULTING FROM 
Supervisory SuGGESTIONS 








TYPE OF EVIDENCE FREQUENCY 





Increased pupil activity and interest..............seeeeeeees 17 
PGNCUNL TRRORER SUMMING oi 6 cass ce cecevecvdenedesssrarsces 14 
SRE MIEN gtr ne oie oad dee's wsiaawee cn Cexsemnannwoneral’ 11 
Tproliment: 1 MUAY COUTIER. «66655 oc cccsdivecesccscdocccces 
BUNCE CECE CNM INNING 6 5554 0.ck ice cv dcvnccesackaccsuteddecees 
Emproved teaching teChnigue....<. cies sccvssccsccccccsccccs 
Number of books read by children................0ceeeeeees 
Improved atmosphere for WOPE.........cccecccccescecccocccs 
OWet CUR GRIN 560 dncée cuneankdouveeddasadeuscens 
Better understanding of principles underlying good technique 
New projects initiated by teacher. ......2.cccccccccesccnoves 
More careful study of individual children................... 
Parente’ 1RVOraDle COMMECNS «1... 6.2 occ ceccccccccvccesecece 
Better habits of work by pupils.......2.cccccccccncsescocece 
More coGdperation with parents .............ccececeeceeecees 
INORG: CONGUE DUMEUNI 6 i'6< oo: sek co Ueinsc de ce cvienesrcuass nee’ 


es ee eed 


| 
| 
! 


g | 





FOU) GGm OF Crrine Se dss cote ook Bc eced inc Cccendeeesnewts 





Objective tests were used eleven times in determining whether 
the supervisory suggestions resulted in the improvement of in- 
struction, but from the reports given it is apparent that super- 
visors consider the subjective factors involved in a teaching 
situation in evaluating the influence of the remedial suggestions 
given. 


CoMPILATION OF PROJECTS AND CASE Stupies REPORTED 


In order that the members of this Department may have in- 
formation concerning the specific projects and case studies 
reported, the committee decided to include here a summary of 
the projects and case studies reported, giving the name of the 
city from which the report was sent, the person responsible for 
submitting it, the purpose of the project or case study, and the 
type of evidence used in evaluating the variable under considera- 
tion. It is felt that this information may be of interest to the 
members and enable them to secure any added information they 
may wish from the individual responsible for the report. 
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CHAPTER VII 


CHECK LIST FOR ANALYSIS OF SUPERVISORY 
ACTIVITIES 


SELF-ANALYSIS OF THE SUPERVISOR 


A study of the evaluation of supervision would be incomplete 
without specific attention to the supervisor himself. Any ap- 
praisal of the individual responsible for supervision is closely 
tied up with the supervisory activities in which he engages and 
with subsequent results. Everything in this yearbook has a. 
direct bearing on the evaluation of the supervisor. However, a 
very necessary element in the evaluation of supervision is the 
analysis of the supervisor himself. 

The question arises as to how this analysis shall be made and 
as to who shall make it. Administrators appraise the super- 
visor when he is employed, when he is reappointed or asked to 
_ resign, and when he is selected to fill a more responsible position 
than the one he holds. Teachers constantly evaluate their 
supervisory officers. These appraisals are often valuable and 
will continue in use whether they are valuable or not. The 
appraisal which will prove most fruitful and most worthy of 
study is that of self-analysis by the supervisor himself. 

The possibility of intelligent analysis by the supervisor of 
himself and his work is dependent upon a satisfactory appraisal 
of the activities and results of supervision. Scientific investi- 
gation is slowly contributing objective evidence which will fur- 
nish a valid basis for judging one’s own work. Until such time 
as there is a sufficient accumulation of facts as to what con- 
stitutes supervision and what activities bring most desirable 
results, we can only experiment with rating scales and check 
lists as a means of improving supervisory service. Such experi- 
ment is justifiable, however. 

Self-analysis through the use of a check list practiced with 
a sanely critical attitude can not help bringing fruitful results. 
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Supervisors can themselves, while working, find out the nature 
and value of their service. 

It is the purpose of this chapter to consider briefly how the 
rating scale has come into use and to recommend the use of 
diagnostic check lists, the chief aim of which shall be to afford 
the supervisor a means of self-analysis to the end that he may 
develop latent abilities in his own performance and that of 
others. 

RatiInG SCALES 


The attempt at judging and measuring the efficiency of 
teachers by means of a formal rating scale seems to have orig- 
inated as far back as 1910.1 Space does not allow even the 
enumeration of all the rating scales and score cards that have 
since been constructed and tried out on the teaching population. 
No final, conclusive evidence is yet available as to the value to 


‘be derived from the use of these scales.” 


The purpose of these earliest rating schemes was probably 
the autocratic one of enabling those in authority to judge and 
assume to measure the fitness of their teachers for retention or 
for earning promotion. The emphasis was, and apparently is 
still, to a large extent, on the teacher himself and his perform- 
ance. This purpose has been undergoing a change, even though 
that change is not always apparent in the construction of © 
modern rating scales. Rugg* in 1920 published the results of 
a significant study he had been making under the title, “Self- 
Improvement of Teachers Through Self-Rating: A New Scale 
for Rating Teachers’ Efficiency.” This is the earliest published 
recognition of the fact that improvement is made really pos- 
sible when the individual becomes critical of his own work and 
desires to improve it. Self-rating scales were an important 
addition to what had previously been done. 

More recent scales show a further shifting in emphasis. At- 
tention is being turned from the teacher himself to the results 


1 Elliott, E. C., “A Tentative Scale of the Measurement of Teacher Effici- 
ency.” University of Wisconsin, Twelfth Yearbook, Part I, p. 68. 

Ruediger, W. C., and Strayer, G. D., “Qualities of Merit in Teachers.” Jour- 
nal of Educational Psychology (May, 1910), 272-278. 

2? King, Leroy A., “The Present Status of Teacher Rating.” American School 
Board Journal, LXX (February, 1925). 

* Rugg, H. O., “Self-Improvement of Teachers Through Self-Rating: A New 
Seale for Rating Teachers’ Efficiency.” Elementary School Journal, XX (May, 
1920), 670-684. 
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he obtains. What happens as a result of what the teacher does 
is more important than his actual performance. Whereas educa- 
tional literature is filled with various schemes for teacher rating, 
the use of this method in attempting to measure the work of 
principal and supervisor has been slow in arriving. To be sure, 
the matter has been mentioned now and again, but, at least until 
recently, the same zeal has not been applied as has been current 
in the construction of rating scales for teachers. Even a casual 
critic of education might suggest that, if any value lies in the 
use of a rating scale, the efficiency of the principal and super- 
visor should be subjected to the same close scrutiny by means 
of it as is given to the rank and file of teachers. Delay in 
appropriating the rating scale as a means for evaluating super- 
visory efficiency may be due to a skepticism regarding the value 
to be derived from its use, especially if it is to be employed 
merely as a means of indicating the rank order of the 
supervisor. 

McClure * found in 1925 that the rating of principals, although 
practiced in a number of cities, was not very widespread. He 
urged the serious consideration of this rating in service as an 
aid in the attaining of wider recognition of the principal’s im- 
portance. 

An interesting and valuable recent contribution showing signs 
of progress in the construction and use of scales is one that 
comes from Detroit.6 It is a rating scale for principals. Two 
significant elements stand out. In the first place, the scale is 
self-made; it was constructed by the district principals of Detroit 
under the direction of the Department of Research. Further, in 
the construction of the scale, judgment of the effectiveness of 
the principal’s work is based chiefly on the results which he 
secures. 

While much has been written regerding the qualifications for 
supervisors and standards of efficiency in supervision, few rating 
scales have been constructed and most of these are of recent 
date. One searches in vain for a record of results of the use 
of any of these scales. The pioneer effort in the construction 

*McClure, Worth, “The Rating of Elementary School Principals in Service.” 
Fourth Yearbook, Department of Elementary School Principals, National Edu- 
eation Association (1925), 424-446. 


5 Detroit Elementary Principals’ Rating Scale. Department of Research, 
Board of Education, Detroit, Michigan. 
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of a supervisory rating scale was made by Cranor,® who 
published in 1921 “A Self-scoring Card for Supervisors as an 
Aid to Efficiency in School Work.” It is significant that this 
scale for supervisors is a self-rating one. It is conspicuous, too, 
for its emphasis on the work being done rather than on the indi- 
vidual doing it. Subsequent publications show this character- 
istic of self-rating; in fact nearly all the published score cards 
for supervisors are self-rating scales. 

It is legitimate to ask certain questions regarding an instru- 
ment which has been widely used and bids fair to gain even 
wider circulation. Is there any place for the rating scale ex- 
cept as a self-rating one or for survey purposes? Will the 
widespread use of rating scales tend to mechanize teaching and 
supervisory performance? Can they be made sufficiently flexible 
to prevent this? Can a rating scale ever be an objective instru- 
ment? In the zeal for obtaining precise measurement, is there 
a danger of overlooking human values which are an essential 
part of successful supervision but which are as yet non-measur- 
able? Is rating by points a necessary part of scale construction? 
There are expressions of opinion in answer to these and many 
other questions, but little clear-cut evidence is available. That 
they have not been answered does not mean that they can not be 
answered. 

Many of the criticisms aimed at rating scales are in reality 
criticisms, not of rating scales as such, but of their construction 
and administration. Careful study will in time show the 
validity or fallaciousness of such criticism. 

This committee recommends the use of a check list to be made 
in the place in which it is to be used and by the people who 
are to use and profit by it. It is felt that the chief purpose of 
such a check list is that of diagnosis and self-analysis and that 
the element of rating should play an unimportant part until more 
facts concerning supervision are available than at present. 


PRINCIPLES RELATIVE TO THE CONSTRUCTION AND USE 
or Cueck Lists 


The committee recognizes a few general principles relative to 
the making and using of check lists. 


*Cranor, Katherine, “A Self-scoring Card for Supervisors as an Aid to Effi- 
ciency in School Work.” JZducational Administration and Supervision, VII 
(February, 1921), 91-102. 
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1. A check list has no place except as it facilitates learning. 
The school’s primary purpose is to render educational service 
to children; and unless the check list functions finally to that 
end it has no excuse for being. 

2. Check lists should be constructed with a specific situation 
in mind and should be consistent with the point of view in educa- 
tion maintained in that situation. 

3. Emphasis should lie on results and the activities which pro- 
duce them rather than on personal traits. 

4. Check lists should be comprehensive enough to cover all 
the service they endeavor to analyze, but should not attempt to 
include every detail of that service. The inclusion of too many 
details may be a hindrance rather than a help to a supervisor 
worthy of the name. 

5. The list should be so constructed as to allow much flexi- 
bility in its application. It should recognize the principle of 
individual differences in teachers and strive to avoid encouraging 
stereotyped performance. It should be concerned with the 
steady, continuous growth of teachers. 

6. A check list, to be valuable, should be devised to secure 
the codperation of the persons who are asked to use it. Admin- 
istrators, supervisors, and teachers should participate in its con- 
struction. Subsequent examination and use of check lists should 
be followed by critical evaluation and discussion. Lists should 
be modified and revised in the light of evidence found as to their 
validity and usefulness. There should be no hesitancy in dis- 
carding any element which is found to be of no value. 

7. The terms used should be simply and clearly stated. Un- 
important elements should, as far as possible, be omitted. 
Words should be selected that will lend themselves to ease in- 
stead of difficulty of interpretation. Ease of administration is 
an essential element. 


A CHECK LIST FOR ANALYZING SUPERVISORY 
SERVICE 


GENERAL EXPLANATION 


The use of a check list is suggested as a means of analyzing 
and evaluating one’s own work with a view to appraising and 
improving it. A check list is suggested rather than a more 
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formal rating scale because the committee feels that present 
knowledge of the ways and means of supervision and of results 
obtained is too meager to warrant the use of any measure which 
might presume to be precise and final. The check list suggested 
is not in any sense an instrument of measurement; it is intended 
to be used for diagnostic purposes. The result of this self- 
analysis should be to discover what is being accomplished 
and to identify those activities and characteristics which 
are functioning actually to facilitate learning in children and 
teachers. 

The criteria discussed elsewhere in this work have been closely 
followed in the construction of the list. 

The unit school situation, with its needs and with the phi- 
losophy which dictates its policy, must be taken into considera- 
tion when building a check list. Consequently, the check list 
which follows is suggestive only of what can be done. It is not 
intended or designed to fit all situations. It is to be hoped that 
it will serve as a guide for constructing other lists that will fit 
a local situation and that check lists so constructed will be used 
experimentally to determine the value which can be derived 
from their use. 

The activities listed are those which the committee has agreed 
upon as being in the supervisor’s province. These activities are 
being used by supervisors in the field. Their relative or even 
ultimate importance has yet to be determined. In fact, future 
investigation may necessitate leaving out items now included. 
Again, the check list, properly used, should help to determine 
that. 

It is felt that the results which a supervisor achieves are the 
best indication of the effectiveness of his work. Consequently, 
these are considered first. The list of personal traits is pur- 
posely brief. No one can question the desirability of a super- 
visor’s, possessing as many admirable personal qualities as 
possible. The difficulty lies in arriving at any common agree- 
ment as to the selection of characteristics, the definition of 
terms, or the significance of any given trait in producing results. 

No attempt is made to weight the various elements. It is felt 
that weighting would be justified only if evidence were avail- 
able as to the relative importance of the items enumerated. 
Moreover, since the check list is to be used for self-analysis 
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rather than for rating, it seems possible to realize the purpose 
without weighting the elements. 

No provision has been made for a final accounting. A sum- 
mary is possible, such as the one which Kyte and Howe’ have 
used in their diagnostic rating scale for teachers. After under- 
scoring the items according to the three degrees mentioned, a 
general conclusion can be made: below average, average, su- 
perior. 

Each item is followed by three descriptive terms which sug- 
gest three degrees of achievement. The explanation which 
follows each item should be read before attempting to determine 
which degree one has attained. 


CHECK LIST FOR SELF-ANALYSIS 


I. RESULTS OF THE SUPERVISOR'S ACTIVITIES 


A. EFrecT ON PUPILS 

1. Initiative (lacking, moderate, marked) 

Children are growing in ability to initiate worthwhile activities. 

2. Responsibility (careless, passive, careful) 

Children are developing ability and willingness to assume respon- 
sibility for the successful outcome of school activities. 

3. Methods of study and work (inefficient, ordinary, efficient) 

There is growth in ability to see problems in life situations, in 
ability to plan and carry out the solution of these problems and 
in the ability to generalize and transfer solutions. 

4. Use of leisure (inferior, average, superior) 

There is a growing tendency for the children of the community 
to make wise use of their leisure time. There is a decrease in 
aimless activity and an increase in wholesome enterprises for out 
of school hours. 

5. Health habits (careless, moderate, careful) 

Children are acquiring those habits which produce and maintain 
good health. 

6. Achievement in the “Three R’s” (inferior, average, superior) 
Children display satisfactory achievement in reading, writing, arith- 
metic, language, and spelling. 

B. Errect ON TEACHERS 

1. Understanding of child nature (little, passable, superior) 

The supervisor guides his teachers to a more adequate knowledge 
and better understanding of child nature in the light of the con- 
tributions of science in the fields of biology, psychology, and 
sociology. 


' Howe-Kyte Diagnostic Rating Card. Can be obtained from G. C. Kyte, Uni- 
versity of Michigan, Ann Arbor, Michigan. 
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. Understanding of human relations (little, passable, superior) 


The teachers are growing in their ability to recognize and respect 
the personalities of other people, particularly children. 


. Understanding of educational values (little, passable, superior) 


The supervisor guides his teachers in acquiring a knowledge and 
understanding of the larger issues in education. He is concerned 
with vital problems of child welfare and leads his teachers to a 
keener interest in current educational problems and to a scientific 
attitude toward their profession. 


. Recognition and diagnosis of teaching difficulties (weak, limited, 


skillful) 
The supervisor helps his teachers to recognize the difficulties which 
daily confront them. Teachers are learning how to evaluate and 
diagnose difficulties. 


. Techniques for solving teaching problems (ineffective, ordinary, 


effective) 
The supervisor stimulates his teachers to organize try-out tech- 
niques for problem solving and to report and evaluate the results 
of such procedures. 


. Improvement in technique of classroom instruction (little, passable, 


marked) 

The supervisor directs teachers toward acquiring control over teach- 
ing method. He sees that his teachers acquire intelligent under- 
standing of approved methods. 


. Use of materials and equipment (questionable, limited, effectual) 


The teachers are skillful in the choice and use of instructional 
materials. They are in possession of the means of evaluating 
these. 


. Management of routine matters (weak, moderate, skillful) 


The schoolroom machinery runs smoothly. The attention given 

it is reduced to a minimum while a high degree of efficiency is 

maintained. 

Teacher participation (little, limited, considerable) 

There is a spirit of codperation among teachers, supervisors, and 

principals and the teaching force shows a maximum of activity 

in conferences, meetings, curriculum construction, educational pro- 

grams, community affairs. 

Voluntary requests for supervisory assistance (infrequent, limited, 
frequent) 

The supervisor develops among teachers the ability to make intel- 

ligent requests for supervisory assistance. 


C. Errecr ON COMMUNITY 

Interest in school (weak, mild, hearty) 

The supervisor helps to maintain interest by keeping the com- 
munity informed concerning the activities and objectives of the 
school. 


1. 
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2. Appraisal of school (lacking, passive, discriminating) 
The criticism of school activities is intelligent and constructive. 
3. Readiness to support and improve schools (hindering, passive, 
marked) 
The community is ready, after intelligent study of the situation, 
to furnish necessary and sensible support, financial and otherwise. 
4. Codperation with school officials (little, acceptable, considerable) 
There is a spirit of codperation between the school and the com- 
munity. 
D. Errecr ON SUPERVISOR 
1. Self-appraisal (uncritical, ordinary, critical) 
The supervisor is able to make valid self-criticism and profit by it. 
2. Creative effort (lacking, moderate, marked) 
The supervisor recognizes and encourages creative effort among 
his co-workers and makes a contribution himself to the progress 
of education and child welfare. 
3. Amount of codperation (insufficient, moderate, considerable) 
The supervisor makes use of every opportunity to codperate with 
administrators and teachers, and with members of the community 
where such codperation means improvement in learning conditions. 
4. Nature of codperation (weak, commonplace, hearty) 
The supervisor displays unusual ability to get along with children, 
teachers, administrators, and people in the community. He is 
actively codperative and is sincere and open-minded in his deal- 
ings with others. 


II. SUPERVISORY ACTIVITIES 

A. SUPERVISORY PLANNING (meager, commonplace, extensive) 

The supervisor has a well-organized plan of action. This plan is 
comprehensive and forward-looking, and is arrived at after a 
careful survey of the local situation and its needs, both present 
and future. It is based on the philosophy of education accepted 
and upon modern principles of education. It is a codperative 
endeavor, the result of consultation with the entire supervisory, 
administrative, and teaching force. 

B. OBSERVATION OF CLASSROOM SITUATIONS (indefinite, passable, definite) 
Visits are planned with a definite purpose in mind. The super- 
visor displays skill in the evaluation of both pupil and teacher 
activity and in his ability to use this evaluation as a basis for 
constructive help in the improvement of learning conditions. 

C. INDIVIDUAL CONFERENCES (destructive, passable, constructive) 

The supervisor organizes his conferences around a central purpose. 
He has an intelligent understanding of approved methods and 
materials and is capable of analyzing an observed situation and 
of discussing it with others. He endeavors to get the teacher’s 
point of view and to stimulate him in analyzing his own problems 
and suggesting their solution. There is a spirit of codperation 
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present and a maximum of participation on the part of the 
teacher. The conference is marked by satisfactory results apparent 
to both teacher and supervisor. 
D. Teacuers’ MEETINGS (valueless, ordinary, valuable) 
The supervisor holds frequent meetings to provide instruction in 
and discussion of pertinent, vital problems. He is skillful in the 
technique of conducting meetings and of planning meetings to 
serve various ends. An essential feature of these meetings is a 
healthy spirit of codperation and a generous amount of discussion 
in which those present participate. 
E. SuPERvISORY BULLETIN (useless, limited, useful) 
: Bulletins are sent out when needed to serve some useful purpose. 
| There is a careful check-up to determine the effectiveness of the 
| bulletins. Teachers are given instruction in the filing of this 
material so that its maximum value may be realized. 
| F. CurricuLum construction (doubtful, ordinary, thorough) 
| The supervisor is a well-informed student of current methods of 
) curriculum construction. He initiates or codperates in the mak- 
ing, revising, and interpreting of the course of study. The results 
of his work are evaluated and recognized as an outstanding 
achievement. 
G. Researcu (little, average, considerable) 
The supervisor knows and observes the principles of scientific 
method. He gives some time to experimentation and research 
and directs others in similar activities. He encourages the scien- 
tific attitude in his teachers. He keeps in touch with the research 
being done elsewhere and is trained in interpretation of the results 
of experimentation. : 
H. Use or TESTS AND MEASUREMENTS (ineffective, helpful, effective) 
The supervisor knows the field of measurement, the usefulness of 
standard tests and their limitations. He uses these instruments 
chiefly for diagnostic purposes. 
I. Use OF DEMONSTRATION LESSONS (ineffective, commonplace, effective) 
Demonstration lessons are carefully planned and followed by profit- 
able discussion. The supervisor notes observable effects in subse- 
quent classroom performance. 
J. PROVISION FOR PROFESSIONAL STUDY (inadequate, moderate, adequate) 
The supervisor encourages his teachers to take advantage of oppor- 
tunities for further training when such training seems advisable. 
K. Co6pPERATION WITH PRINCIPALS IN SUPERVISION (little, limited, consider- 
able) 
The supervisor works in coéperation with the principals in regard 
to supervisory service. 
L. K®EPING OF SUPERVISORY RECORDS (inefficient, ordinary, efficient) 
The supervisor keeps an adequate record of his plan of work and 
the activities utilized in carrying it out. He provides for the 
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collection and filing of all data significant to a continuous growth 
program for teachers and children. The amount of time devoted 
to keeping records does not infringe upon the time which should 
be spent in more important functions. 
M. Use oF SUPERVISORY RECORDS (inadequate, passable, thorough) 

The supervisor makes use of these records in aiding teachers, in 
appraising his own work, and in revising his plans to meet the 
situation more adequately. 


N. APPRAISAL OF SUPERVISORY ACTIVITIES (little, mild, considerable) 
The supervisor studies carefully the activities in which he engages 
in order to find out their value and relative importance. This 
close analysis results in some objective evidence. 


III. THE SUPERVISOR 
A. PERSONALITY 


. Intelligence (inferior, average, superior) 

. Leadership (lacking, passive, powerful) 

. Creative ability (lacking, moderate, marked) 

. Poise (unstable, balanced, confident) 

Tact (blunt, frank, diplomatic) 

. Sympathy (cold, moderate, considerate) 

. Personal appearance (careless, ordinary, particular) 

. Breadth of interest (narrow, limited, wide) 

. Attitude toward life (pessimistic, passive, optimistic) 
10. Ability in public speaking (inferior, average, superior) 


CHNOAhRwWneH 


B. GENERAL PREPARATION (meager, passable, extensive) 
The supervisor has a liberal education in fields outside that of 
supervision. He reads current publications covering a wide range 
of interests—books of travel, biography, current developments, and 
general literature. He has traveled widely and has acquired varied 
experiences which give him a rich background upon which to draw. 

C. PROFESSIONAL PREPARATION (meager, adequate, extensive) 
The supervisor has had superior professional preparation and has 
taken courses in general and educational psychology, curriculum 
construction, tests and measurements, supervision and administra- 
tion. He reads professional magazines and current professional 
publications, and keeps in touch with important researches. 

D. ProFpsSIONAL EXPERIENCE (inadequate, moderate, extensive) 
The supervisor has had much successful experience in teaching 
and in directing others; or possesses that unusual ability which, 
when adequately developed, makes extensive experience unneces- 
sary. 








CHAPTER VIII 


CASE STUDIES OF SUPERVISORY PROGRAMS 


It is the belief of the committee that an actual report of the 
supervisory programs carried out in a few chosen localities, and 
an evaluation of the strengths and weaknesses of these programs 
by those most directly concerned in making them effective, 
would constitute a valuable chapter in a yearbook dealing with 
the evaluation of supervision. This chapter is a presentation 
of such reports. , 

Four city supervisors and one member of a state department 
of education responsible for a program of rural supervision were 
asked to report to the committee in their own words the full 
details of the supervisory program which they initiated and 
carried out through a period of years. Each of these super- 
visors was asked to conclude her report with her own evaluation 
of the strong and weak features of the original programs in the 
light of their apparent success in actual practice. 

Miss Delia Kibbe, of the State Department of Education in 
Wisconsin, presents her report of the rural supervisory program 
in that state. The city supervisors whose reports are here given 
are Miss Elma Neal, Assistant Superintendent in charge of 
Elementary Schools in San Antonio, Texas; Miss Ida Odelle 
Rudy, Supervisor of Kindergarten and Primary Grades in Day- 
ton, Ohio; Miss Mildred English, Assistant Superintendent in 
charge of Elementary Schools in Raleigh, North Carolina, and 
Miss Julia Letheld Hahn, Director of Kindergarten and Primary 
Grades in San Francisco, California. 


Case No. 1—WISCONSIN’S RURAL SUPERVISORY PROGRAM 


Deuia Kissa 
State Department of Education, Madison, Wisconsin 


Purpose or Program 
The plan of supervision of rural schools inaugurated by the Wisconsin 
Department of Public Instruction has as its main purpose the guidance 
108 
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of and codperation with the various rural teacher training institutions, 
and the training of and codperation with the local county rural super- 


visors in service throughout the state. Few of the supervisory activities 
initiated directly from the state office reach the rural teacher; the direct 
contacts are made with the rural supervisory personnel of each local unit. 


PERSON NEL 


The personnel of the State Department, assisting the State Superin- 
tendent of Public Instruction, consists of an assistant state superintendent, 
a legal adviser, three elementary supervisors, three state graded school 
supervisors, three village and high school supervisors, five special education 
supervisors, One supervisor of school board conventions, one supervisor 
of school buildings, and two supervisors of school libraries. 


Supervisory AcTIvITIES 


The various supervisory activities projected by the State Department 
are as follows: 

1. Annual meeting of all county rural supervising teachers. This meet- 
ing is called by the State Superintendent of Public Instruction. The neces- 
sary traveling and living expenses of the rural supervisors are paid from 
state funds. The meeting is usually held the last week in August in 
the vicinity and at the time of the Wisconsin State Fair, thus providing 
an opportunity for the supervisors to study the educational and other 
types of exhibits and to become more thoroughly acquainted with the 
industries and products of the state. This is a valuable educational experi- 
ence for these workers. At this meeting the state program for the year, 
along with other topics, is presented. Each topic has been discussed at 
two or more of the former conferences, so that there is a sequential and 
continuous program of state supervision. Among the topics which have 
been discussed during the last five years are the following: local programs 
of supervision; analysis of stenographic reports on class exercises; teacher 
rating devices; supervisory self-rating plans; job analysis of supervisory 
activities; special education for the mentally and physically handicapped; 
presentation of special subjects such as music, art, physical education, 
social sciences, conservation, etc.; curriculum revision. 

In addition to the speakers emphasizing these topics, representatives of 
other interests, such as of the state parent-teachers’ association, of health 
education, and persons with a general message of stimulation have ap- 
peared on the programs. 

2. Individual visitation. The elementary supervisors of the State De- 
partment devote a share of their time to individual visits with each county 
rural supervising teacher. At the time of these visits the state worker 
accompanies the county supervisor in visits to a few rural schools. The 
school situation is observed, studied, analyzed codperatively, and used as 
a basis for a later conference. Occasionally the state worker may demon- 
strate a particular supervisory activity; more frequently the county super- 
visor goes about her work as usual, while the state supervisor observes 
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and participates wherever opportunity is presented. At the close of the 
day the supervisors, in codperation with the county superintendent, par- 
ticipate in a detailed conference during which the work observed and 
the supervisory problems presented are discussed and suggestions for 
future plans for local supervisory activities are considered. 

3. Sectional meetings. At intervals during the year the county rural 
supervisory teachers meet in small groups of from eight to fifteen persons 
for consideration of various supervisory problems. One series of meetings 
each year is called by the State Superintendent of Public Instruction and 
one member of the elementary supervisory staff meets with each group. 
At other times sectional meetings are called, planned, and conducted by 
the county supervisors, who maintain a state organization with sectional 
chairmen responsible for these meetings. 

4. Codperation with rural teacher training institutions. The state ele- 
mentary supervisors spend some time each year in visitation at the 
various rural teacher training institutions. The local county superin- 
tendent and rural supervising teachers usually visit these institutions in 
company with the state supervisor. Various problems of present and 
future rural teacher training are discussed with the faculties of these 
schools; and state conferences are held each year for the members of 
the teacher training schools. The faculties of these schools usually attend 
the sectional meetings of the county rural supervising teachers. 

5. Supervision through bulletins. At irregular times bulletins of sug- 
gestions for improvement of the supervisory work of the state are pre- 
pared by the members of the State Department of Public Instruction and 
distributed to the workers of the state. Last year, the State Department 
distributed to the rural teacher training institutions bulletins containing 
19,740 problems designated by the rural teachers of the state as their 
outstanding teaching problems during the school year of 1928-1929. 

6. County teacher institutes. The state elementary supervisors may 
serve individual counties as speakers on the county institute programs. 
This service is supplied upon request from the county superintendent and 
the work presented is in accord with the local county program of educa- 
tion. There is no state program for this work. 

7. Supervising teachers’ exchange bulletins. The county rural supervisors 
maintain an exchange bulletin issued twice each year, which is mimeo- 
graphed and distributed by the State Department of Public Instruction. 
Members of the staff codperate as requested in preparation of the material 
for the exchange. 

8. Service problems. The members of the Department are available at 
all times to respond to requests for special assistance through correspond- 
ence or personal visits, and much of the time is devoted to this type of 
individual codperation. 


LIMITATION OF THE PRoGRAM 


The lack of sufficient funds prohibits the Department from initiating 
desirable testing, experimental, and research activities as a part of the 
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state educational program. A state-wide county institute program is like- 
wise impossible with the present financial and personnel limitations. How- 
ever, through the full codperation of the local supervisory personnel, the 
members of the department feel that there is a fairly unified and progres- 
sive state program of rural education in progress throughout the state of 
Wisconsin. 


Case No. 2—A PROGRAM OF SUPERVISION IN SAN ANTONIO 


Eima A. Nau 
Assistant Superintendent, San Antonio, Texas 


ORGANIZATION AND PERSONNEL 


The school board of a progressive school system recognizes the office 
of superintendent of schools as the logical center of responsibility for the 
professional and business management of the organization. In a large 
system many of these duties must be delegated by him to other officials 
to insure efficient management. 

San Antonio follows the “line and staff” organization in the delegation 
of responsibilities. In the elementary department the line of administra- 
tive authority is carried from the superintendent to the assistant superin- 
tendent in charge of elementary schools, to the principals, to the teachers, 
and to the children. The supervision of instruction is carried on by the 
assistant superintendent and a staff of three general supervisors, two 
special supervisors of music and art, and the principals. 

As the direct representative of the superintendent, the assistant superin- 
tendent has the administrative and supervisory responsibility for the 
department. This entails the recommendation for election and placement 
of principals and teachers, the holding of group meetings and individual 
conferences with principals and supervisors for the purpose of setting 
policies and discussing problems of the department, the visitation of build- 
ings to consult with principals on matters pertaining to the administration 
of their schools, and the direction of the supervisory activities of prin- 
cipals and supervisors. 

The principal of the school is a line officer with authority delegated 
directly from the assistant superintendent, and is responsible for the 
administration and the instruction in his building. In advancing his 
educational program he utilizes all agencies at his command: the courses 
of study, the help of the supervisors, the contributions of the classroom 
teachers, the faculty meetings at which recent educational literature is 
discussed, and the building and central office tests as an aid to teachers 
in determining abilities and growth of individual children. 

The general supervisors work directly from the central office and are 
subject to call, either by direct request of the principal or as the result 
of a conference between the assistant superintendent and the principal. 
At the schools, their activities may center around the individual needs 
of inexperienced teachers or the assistance of experienced teachers in 
such activities as planning units of work, carrying on scientific or informal 








112 THE EVALUATION OF SUPERVISION 


experiments, and working on course of study materials. Other activities 
include the conducting of training classes for inexperienced and new 
teachers, the carrying through of testing programs, and work on curriculum 
and experimental materials. 

The program for the department is planned by the assistant superin- 
tendent and staff in codperation with the principals and teachers, in the 
belief that participation in the formulation of aims will bring about a 
more unified and purposeful effort. Some of the activities, such as survey 
and diagnostic testing, may be completed during a semester or year; and 
others, such as curriculum revision, are a part of a program that extends 
over a period of years. 

Supervisory Activities 

Some of the activities that have been engaged in during the past several 
years are given: 

Curriculum revision. The reconstruction of the curriculum has formed 
the basis of department activities. The best of the old course of study 
has been retained, and revisions and additions have been made in the 
light of the findings of scientific research and best known procedures. 
Local experimental studies also have contributed to the materials included. 

Curriculum revision has been directed by the assistant superintendent 
and staff. All materials are developed by the principals and supervisors 
in codperation with the classroom teachers. These materials are then 
mimeographed and sent out to the schools for testing in the classroom. 
Following this experimental try-out, the course is revised and is then 
printed so that it will be in more usable form. 

The first course completed was the English Monograph, which was 
printed in 1926. This bulletin includes courses in reading, language, litera- 
ture, spelling, and writing. In general, each course is organized around 
objectives, grade placement of subject matter, suggested methods of pro- 
cedure, suggested activities and illustrative units of work, standards of 
attainment, and bibliographies. The reading course is the most complete. 
It is planned, when revised again, to add much in the way of suggested 
units of work for this subject and many suggestions to aid in the con- 
struction of other courses. 

In 1929, the Social Studies Monograph was put into printed form. The 
term “social studies” is applied to the range of .activities and materials 
in the study of geography, history, and civics, health, safety, and char- 
acter education, which will enable the child to comprehend more fully 
the development of modern life and to. assume his responsibility as a 
contributing member of society in the home, the school, the community, 
and the outside world. Since growth does not take place in compartments 
but by drawing upon various closely related fields of information and 
skill, the subject matter and activities in the various fields of social science 
are clarified and enriched by one another. 

The course is organized around suggested units of work for the various 
grades that have been found, by experimentation, to be effective in reach- 
ing the objectives of the course. These units of work are the outgrowth 
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of the attempt to give a well-rounded development in the attitudes and 
appreciations, habits and skills, knowledges and informations that are 
suited to the level of child growth in each grade. In presenting the 
materials there is a very definite plan for the acquisition of knowledge 
in regard to the growth of our community, our state, and our country, 
and to their interdependence on each other and on other parts of the 
world in the fields of trade and culture. 

The arithmetic course, which has been in use in experimental form, is 
now in the hands of committees for its final revision before being printed. 

The fact that more than fifty per cent of the children in the elementary 
schools come from homes in which English is not spoken presents the 
problem of developing a curriculum especially adapted to their needs. 
Generally speaking, there has been a confusion of the aims in the teaching 
of reading to children of English and non-English speaking parents. A 
study of the situation indicated the necessity for giving the latter group 
a practical English speaking vocabulary for use on the playground, in 
the home, and in the community; for developing in them the social 
habits, attitudes, and ideals of American citizens; and for providing 
broadening experiences that would prepare them for wider activities. 
These steps precede, and also accompany, the training in the fundamental 
skills and knowledges. 

Through a survey of community conditions, materials that would func- 
tion in the lives of these children were determined. Later these mate- 
rials were related to the children’s school, home, and community activ- 
ities. By means of classroom experimentation extending over a period 
of years, units of work and a definite technique based on the direct 
method were developed. 

As a result of this experimentation, the children of non-English speak- 
ing parentage are speaking better English; they are developing social 
habits and ideals of cleanliness, courtesy, self-respect, and fair play; and 
they are carrying on the work of the upper grades normally, as is attested 
by standard and informal tests. 

Experimentation. Believing that, if education is to become a science, 
there is need for a body of tested knowledge based on objective evidence, 
we have undertaken to carry on classroom experimentation. Formal 
studies, involving whole grades, are conducted under the direction of the 
assistant superintendent and staff, working with committees of principals 
and teachers. In addition, teachers are encouraged to carry on informal 
experiments within the classroom in an effort to improve their own 
techniques. 

One of the first of these studies undertaken by the department was in 
the field of silent reading. The need was felt for adding to the general 
skill acquired in the primary grades some special techniques that would 
enable the children in the upper grades to interpret more effectively the 
contents of their text and supplementary books. Committees of experi- 
enced teachers from the grades made an analysis of the techniques needed 
by the children, and formulated procedures for teaching some of the more 
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important types. These procedures were then mimeographed and pre- 
sented to all teachers of the grades involved, to be tried out and criticized, 
before the final revision and printing in the reading course of study. The 
results of the use of these procedures were checked by means of the 
Thorndike-McCall Reading Scale, which indicated a marked improvement 
in the children’s ability to read.’ 

An experiment in the more effective teaching of common fractions was 
carried on by teachers of Grade VA. Following an analysis of the 
types of examples in common fractions, diagnostic tests, remedial practice 
sheets, and reviews were formulated. This experimental material was used 
by one-half of the pupils of Grade VA, while the other half followed the 
usual procedure. Preliminary and final standard and informal tests given 
to the two groups indicated a decided gain for the experimental over the 
control group. 

Tests and Measurements. An extensive testing program has been car- 
ried on from time to time as a part of the experimental procedure, as a 
means of testing materials and procedures for use in courses of study, and 
for survey and diagnostic purposes. Standard tests, such as the Stanford 
Achievement Test, the Thorndike-McCall Reading Scale, and the Sangren- 
Woody Reading Test have been used to measure achievement and make 
comparisons of the accomplishment of San Antonio children with those 
of other parts of the country. These tests, together with informal ones 
based on the local courses of study, have been used especially to diagnose 
the difficulties of the city, the class, and the individual child. They are 
nearly always administered and scored by the teachers. 

In addition to the achievement tests, group and individual intelligence 
tests are administered by a teacher in each school who has had training 
in testing, or by a member of the staff. The results of these tests are 
used, with information from achievement tests, teacher judgment, and a 
study of the child’s physical and social development, chronological age, 
and home conditions, in an attempt to determine individual abilities and 
interests as a basis for teaching. Special classes are provided for problem 
children. The needs of all other children are met by means of curriculum 
adjustment. 

Training Class for New and Inexperienced Teachers. A training class 
is conducted for new and inexperienced teachers to enable them to become 
familiar more quickly with materials and methods in the courses of study. 
The supervisors meet with those teachers from their divisions and hold 
two afternoon round-table discussions and two morning demonstrations 
in classrooms each month. 

Other Activities. Other activities given special attention in the depart- 
ment include those pertaining to the improvement and maintenance of 
health, to safety education, and to character education. 


1 Neal, Elma A., and Foster, Inez, “A Program of Silent Reading.” Zlemen- 
tary School Journal, XXVII (December, 1926), 275-280. 
2 Neal, Elma A., and Foster, Inez, “An Experiment with Remedial Work in 


Common Fractions.” Hlementary School Journal, XXIX (December, 1928), 280- 
284. 
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EvaALUATION OF ProcRaM 
We feel that there are certain advantages that have accrued from the 
carrying on of a supervision program of curriculum revision, experimenta- 
tion, and testing within the department. This plan has raised the pro- 
fessional level of all members of the department by encouraging pro- 
fessional reading and discussion, and by sharing responsibility for the 
carrying out of the program. It has brought about a more intelligent use 
of the materials and procedures involved because of the direct contact 
with them. It has tended to impersonalize supervision by placing the 
emphasis on a study of the growth of the child. 
While a program involving all members of the department requires a 
longer period of time for development, the values of such a plan far 
outweigh this disadvantage. 


Case No. 3-SUPERVISORY PROBLEMS IN GRADES I-IV OF THE 
DAYTON PUBLIC SCHOOLS 
Ipa Opetite Rupy 
Director of Primary Education, Dayton, Ohio 


CreaTinc THE Desire ror CurricuLuM Revision 

In 1922 the superintendent of schools appointed a general supervisor of 
instruction. Prior to that, only special subject matter supervisors had 
been employed. The system had been of the traditional, formal type; 
departmental lines had been sharply drawn. A course of study which 
had been made by a few principals many years ago was being used; a 
thorough revision was necessary. Since there was a definite need for the 
acceptance of a new educational program preceding the revision of the 
curriculum, the general supervisor for the primary grades organized the 
teaching corps by grades for discussion of modern educational procedures. 

The primary grades had never before been recognized as an important 
part of the school system. The workers with young children realized that 
they were as valuable a part of the school system and as professional in 
their work as were the high school teachers. They became a vital organ- 
ization within a school system and made efforts to educate the public to 
this fact. 

Newspaper publicity. The supervisor wrote articles for the Sunday 
newspaper, entitled: “Snapshots of a Modern Primary School.” Her visits 
to schools gave ample opportunities to write up situations from within 
the system. These articles, always with their settings in a classroom in 
the city, created much discussion among patrons and teachers, who 
looked forward with interest to the next article. 

Extension courses. A member of the staff of a neighboring university 
gave, at a most crucial moment, an extension course on reading and 
activities in the primary grades. The Dean of the School of Education 
of the same university gave several courses in child psychology. The 
courses of both instructors were most effective in building up a morale 
and a desire for research work and study among the teachers. 

The organization by grades helped the teachers to learn to know each 
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other better. They met socially and incidentally discussed their problems 
in a very natural way. They were inspired and became more interested. 

Evidence of a changed attitude. The teachers had been using a strictly 
phonetic method of reading and the equipment was anything but in keep- 
ing with a modern program. For example, in our first grades, desks were 
screwed down to the floor in rows. In 1923, the teachers were organized 
definitely for curriculum construction and they themselves made a course 
of study. At that time it was quite a departure from the older course, 
but it was not yet what they felt it should be. The following outcomes 
of this course were evidenced: 

1. Story readers replaced phonetic readers 

2. Teachers chose what they wanted to use 

3. Six or seven story methods were in use in various sections of the city 
instead of one phonetic method 

4. Tables and chairs began to take the place of desks screwed to the 
floor 

5. A more flexible program developed 

6. Our social studies began to be more integrated 

7. There was a desire to get away from the old formal procedure, but 
the teachers went slowly, feeling their way 

While the points enumerated above were not at all what the super- 
visor’s goal for the work had been, it shows there was a growth by evolu- 
tion rather than revolution. The teachers made their course of study 
and they were using it. Although traditional and formal in emphasis, it 
was superior to what they had been using and it undoubtedly was a step 
forward. 

Feeling the need for a revised curriculum. Teachers began to feel a 
need for more enlightenment. A well-known specialist in reading was 
invited to come to two series of conferences with the teachers. A number 
of other outstanding specialists also came for conferences. These con- 
ferences were a decided help and stimulated many teachers to plan defi- 
nitely for summer study at the universities. 

Gradually the teachers themselves realized that the present course 
which they had made was out-of-date. In their own rooms they began 
revising this course. In 1927, after having used this new, old-type course 
of study, there came a general demand for a new-type course. The 
teachers’ own ideas had been changed. 

There were three distinct types of teachers in service: 

1. New and young teachers, fresh from junior and senior teachers’ col- 
leges. They were naturally full of inspiration and a desire to experi- 
ment. They did not want to do the traditional type of work. They 
had definite ideas as to what the curriculum should be. 

2. Teachers who had long been in the service and had caught the spirit 
of experimentation from the group conferences and from the young 
teachers. This group did not want to be considered “back numbers.” 
They took extension courses and went to summer schools. They 
began organizing flexible programs in their rooms. 
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3. Teachers who had availed themselves of opportunities to study in 
summer schools. They began to experiment after their summer’s 
experience. These teachers had a good background and knew modern 
educational procedures. 

Very few, if any, failed to catch the spirit of experimentation. Little 

friction or antagonistic questioning resulted. Where teachers were per- 
mitted to experiment, they availed themselves of the opportunity. 


ProcraM For CuRRICULUM RECONSTRUCTION 


Selection of grade chairmen. Four grade chairmen—one from each of 
the four grades—headed the organization for curriculum reconstruction. 
These chairmen were selected by the supervisor from among the outstand- 
ing teachers of each grade. The selection was made on the basis of 
general personality traits and an open-minded attitude toward research 
and experimentation. These teachers also had a splendid background 
and were doing excellent classroom work. 

Clearing house committee. These grade chairmen, together with twelve 
excellent teachers from each grade, constituted the clearing house com- 
mittee for each grade. These committees met in council. The committee 
for Grade I met separately and then later all committees came together 
for discussion of their problems. 

Certain goals or standards were set up by the clearing house committee. 
Certain principles were emphasized, such as subject matter as a means 
to an end, a “going-on-ness” of activities, continuum, leads, what is meant 
by curriculum materials, and how to use these materials in selecting con- 
tent and in evaluating pupil progress or in setting up goals, and many 
others. 

Such problems were studied as: How can we maintain individuality 
and take care of the social phase of development? Shall the teacher or 
child initiate activities? What is method? How do we learn? What 
is subject matter? 

When the members of the clearing house committee felt confident of 
their scholarship and ability in the field of curriculum reconstruction, each 
member became chairman of a group of teachers. These groups then 
met with a leader who was able to direct and help them. They also 
worked alone without any dictation from the supervisor unless they asked 
for her assistance. They were therefore free to work out their own prob- 
lems. Everywhere throughout the city committees began working. 

Experimental laboratories. Every room became an experimental labora- 
tory. Records of progress made were carefully kept. Units worked out 
by children were reported by teachers and discussed by the groups. These 
units were placed on file in the central office for teachers to see, read, 
and study. 

Tue R6.e or THB SuPERVISOR 
The supervisor’s principal functions were those of visiting schools, plan- 


ning for conferences and discussion of problems, and arranging with nearby 
universities for extension work. 
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Teachers observed the work occurring in some of the best rooms in 
which teachers had caught the ideas and were experimenting in a very 
interesting way. Weaknesses and strong points alike were observed and 
careful directions helped teachers to grow. 

In schools in which there were three classrooms of the same grade, the 
entire work was open for observation to all teachers on one particular 
day. Discussions followed. The teachers of these classrooms told how 
they had begun and carried forward the units of work in the different 
classrooms. 

Various reactions resulted. Some teachers were discouraged, some were 
encouraged—all were helped. Teachers became anxious to have their 
classrooms the center of activities. They were happy to tell about their 
investigations. They sought help from every possible source. 

Teacher-principal-supervisor conference. Teachers felt the need of dis- 
cussing plans with principals. They wanted the principals to be in sym- 
pathy with their work. They wanted to be helped and guided. They 
asked to have a meeting with principals, in which they could talk things 
over together. 

The superintendent invited all principals of grade schools to meet with 
the clearing house committee of each grade. Every teacher on the clear- 
ing house committee was present at this important meeting. The chair- 
man of each grade presided. The meeting for Grade I was held first. 
The support of principals was solicited in this experimentation and re- 
search. Among the vital problems discussed were the following: smaller 
classes, better equipment, permission to experiment, subject matter as a 
means to an end, the codperation of principals in forming other standards 
of judging this new type of work, individual differences, and methods in 
the teaching of reading. 

Principals were most codperative and interested, as well as pleased, espe- 
cially with the younger teachers, who spoke with confidence and a genuine 
understanding of their needs. These teachers pleaded for opportunity 
to study and to help children. The teachers felt that this could 
be done satisfactorily only by having no more than thirty-five pupils to a 
room. 

Echoes of this meeting soon gave the feeling that it had been most 
successful. Those in charge of the supervisory program are continuing 
this year the problem of curriculum revision and are hoping to have 
something constructive and helpful for all teachers as an outcome of the 
work done in classroom laboratories. 


EVALUATION OF THE Supervisory Work Done 


The following observations concerning the work and attitude of the 
teachers and of the administrative and supervisory staff, while subjective 
in nature, are submitted as evidence of the effects of the supervisory 
program : 

1. A wholesome and improved attitude of the teachers developed by 
permitting them to grow gradually, and by abstention from the use 
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of coercion and critical or destructive methods in evaluating the 
work done 

Teachers came to a realization of their needs through extension 
work, planned definitely by the supervisor and prominent educators 


. Principals, although not thoroughly convinced of its desirability, 


entered codperatively into this work 

The superintendent, through his interest and codperation, helped to 
create a desire to do research 

Classrooms became laboratories for experimentation and research 


. Open-minded attitudes prevailed 


An interrelated and integrated educational program developed from 
the work in the classrooms 
Children, not subject matter, became the center of interest 


. Subject matter became a means to an end 
10. 
11. 


Children thoroughly enjoyed all of their school activities 

Teachers invited supervision and were disappointed when the super- 
visors did not come to visit and help them 

Pride and healthy competition arose among teachers and schools 
Teachers learned to know each other better and social contacts 
developed among them 

Ways and means to secure better equipment became a definite 
problem 


Limitations TO MaximuM ACCOMPLISHMENT 


In connection with this discussion of a program of curriculum revision, 
it seems in order to enumerate a few of the limitations which were real 
handicaps to maximum development of the program: 


I 


2. 


eos 


School buildings needed changing as much as the curriculum needed 
revision 

New equipment was necessary. A different type of seating, tables, 
materials, and such were greatly needed 


. Cupboards for materials were lacking 
. Supervisors and supervisory principals needed to be alert in order 


to be of maximum assistance to the young, newly trained teachers 


. Limited finances made curriculum construction a more complicated 


problem 


. Teachers who helped were doing double work. Substitutes should 


have been available to assist teachers in their work during school 
hours 


. Teachers were tired after a day’s work in the classroom 
. A modern program required a different type of teacher 
. A different type of preparation for teachers is needed if they are 


to solve satisfactorily the many new problems confronting them 


CoNcLUSION 


Supervision, in the light of modern educational theory, is “improvement 
of teachers in service.” Under this broad conception, the supervisor must 
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engage in many different activities and perform various duties. Among 
these activities and duties are the following: 

1. Helping and advising teachers and codrdinating their work 

2. Organizing the teaching corps for the development of curricula 

3. Directing the work of the classroom teachers when necessary by: 
setting standards or goals, helpful visitation, directed observations 
and conferences, and demonstrations based on daily performance 
of an outstanding group of selected teachers 

4. Working with the various groups which were organized for cur- 
riculum reconstruction purposes in order that principles of educa- 
tion might be thoroughly understood in their truest and best mean- 
ings 

5. Centralizing and codrdinating the various committees at work 

6. Evaluating the outcomes and weighing them in terms of modern 
educational procedures 

7. Recognizing needs and providing materials and equipment for 
teachers in order to enable them to carry on their work advan- 
tageously 

8. Helping to create an esprit de corps among the teachers within the 
department 

9. Encouraging social and professional contacts through organizations 
such as will be advantageous in many ways 

With the above ideals in mind, those in charge of the supervision in 
Dayton have attempted to carry on its program in Grades I-IV. In work- 
ing with the program the attitude of the supervisors and teachers toward 
supervision has changed. Supervision has now become constructive, im- 
personal, and codperative. A healthy atmosphere prevails: teachers, prin- 
cipals, and supervisors work together for the good of the children entrusted 
to their care. 

The codperation of principals in this project has been most unusual. 
Had it not been for their interest and willingness to step aside and watch 
with patience the developments in their respective schools, what has been 
achieved would have been impossible. 

Curriculum construction is a “going-on” process, not static, not finished, 
so those in charge of the supervision program are continuing the work 
which began several years ago, and are learning much in the process of 
the undertaking. 


Case No. 4—-THE RALEIGH PLAN OF SUPERVISION 


Miprep ENGLISH 
Assistant Superintendent, Raleigh, North Carolina 


The principles of the New Education apply to supervision as well as 
to the work of the classroom. Learning is active. The teacher and the 
supervisor learn by doing even as the child learns by doing. Teachers are 
more in sympathy with a program which they have had a share in plan- 
ning and more interested in its success than in one that is made by super- 
visors and handed out to them. 
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The Raleigh program is the result of the codperative effort of the 
staff—superintendent, assistant superintendent, supervisors, principals, and 
teachers work together to develop it. Thus each member of the staff 
makes his contribution and is consequently vitally interested in the suc- 
cess of the program. 


Work or THE PrINcIPAL 


A survey of the school and the community is basic to any worthwhile 
educational program. When the present program in the Raleigh schools 
was launched six years ago, the building principals made a study of the 
distribution of their time to see if more time could be found for super- 
vision. As a result of this survey much of the detail work was delegated 
or organized so as to leave the principal time for work in the classroom. 

The principals agreed to accept the responsibility for the supervision of 
their buildings, calling upon the general and special supervisors for expert 
help in making the program of the school fit the needs of the school 
community, in working with the teachers in the classroom, in collecting 
materials, and so on. 

The principal should know the needs of his staff and call for help only 
at the time it is needed. In this way the work of the school is not 
interrupted by having the various supervisors launching a program which 
they wish the teachers to follow. Instead, all are working members of 
the school staff, developing the program agreed upon by the group as 
best fitted to provide for the maximum growth of each individual pupil. 

The group of principals holds regular monthly meetings, at which time 
they study problems of vital interest to the group. Last year a study 
was made of the needs and requirements of a standard elementary school 
with special reference to equipment, materials, building, school program, 
and so on. The assistant superintendent is a working member of this 
group. 


CurricuLuM Revision 


A program of curriculum revision was undertaken by the staff of the 
Raleigh schools six years ago. In connection with the program, three 
different surveys were made: of the schools, to determine the need for 
improving the existing courses of study; of the community, to determine 
its interests and needs; of the educational centers in which courses of 
study were being revised, to ascertain the types of revision undertaken. 

Using the results of these three surveys as a basis, the staff agreed upon 
a program of curriculum revision to extend over a period of ten or twelve 
years. This period will give time to try the material in the classroom, 
to test, to check, and to revise in the light of the results obtained. This, 
it is believed, will furnish a sound basis for comparing the results secured 
through the revised course of study with those obtained under the old. 

One year was given to a wide reading on the part of the staff in order 
to set up objectives for the educational program of the system, both in 
the different subjects and in the different grades. The teachers volun- 
teered for work on the subject in which they were most interested. The 
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work has been done as an after-school contribution of the staff, as no 
teachers have been relieved from classroom duties to do this work. 

Subject matter committees were organized the following year to develop 
in each school subject objectives, subject matter content, correlations, 
materials, methods to be used, and possible outcomes. This was followed 
by having committees take all subject matter reports for a given grade 
and integrate the materials so as to avoid omissions and overlappings and 
so that the entire program might have coherence and unity. 

During the entire period experts and subject matter specialists have 
been called in to discuss with the staff certain definite phases of the 
curriculum. These men and women have lectured to the staff, have met 
committees of teachers to discuss definite problems, and have helped in 
evaluating the work as it has been developed. 

The work in the grade schools and in the first three years of the five- 
year high school is organized around centers of interest in large units 
involving many fields of subject matter and providing varied and rich 
experiences and activities for the pupils. The work thus developed is 
checked against the “check lists’ of content material and fundamental 
concepts in the various subject matter fields. 

Records are kept by the teacher of the way the unit is developed, the 
content taught, and the materials used. Very careful pupil records are 
kept of each child from Grade I through the high school, so that his work 
may be so directed as to provide for his maximum growth. 

Constant evaluation and revision of the content and materials of the 
course is carried on by the staff. This program of curriculum revision has 
resulted in professional growth on the part of every member of the staff, 
as evidenced by a keener insight into the classroom problems and greater 
efficiency in solving them, an atmosphere in the classroom that makes 
for happy pupils who are seeking opportunities for self-expression along 
many lines, a better spirit among the members of the staff, and a more 
wholesome attitude toward the work in general. 


PROFESSIONAL Liprary AND Mareriats Bureau 


During the six years of the curriculum revision program a library of 
professional books and magazines has been growing. As a need has ap- 
peared, books and materials have been secured to meet it. One of the 
greatest needs in the development of the program has been for materials 
for the use of the teacher and pupils in carrying on the unit work. Gradu- 
ally the Materials Bureau has been developed, with pamphlets, bulletins, 
charts, pictures, clippings, magazines, and books giving information on the 
various units going on in the classroom. The central Professional Library 
and Materials Bureau is for the use of the teachers of the entire system. 
Each school building is also developing its own Materials and Reference 
Bureau. 

Teachers and children give real help in collecting and filing materials. 
This year, for the first time, half the time of one teacher is given to 
assisting in this work. 
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ELEMENTARY Epucation CounciL 


An evidence of the teachers’ initiative in the work is shown by the 
activities of the Elementary Education Council. The members choose 
their officers, call regular meetings and plan the program of work for the 
year to meet the needs of the grade groups. Through grade groups and 
special committees, problems of interest to the various groups are studied. 
Last year the Council took as the subject of the year’s work, reading in 
the different grades, and each grade group worked on problems in reading 
peculiar to that grade. A yearbook was issued giving the results of the 
year’s study. 

Quarterly bulletins are issued by the Council. Each number is devoted 
to some phase of the work of special interest at that time. During the 
past year the series included an issue on each of the following: “The 
Elementary School Library,” “Elementary Science Work in the Schools,” 
“Large Unit Teaching and Creative Work.” This work is initiated and 
carried on by the members of the Council, the assistant superintendent in 
charge of instruction acting in an advisory capacity and on call of the 
various committees and officers. 


Work or Assistant SUPERINTENDENT 


The assistant superintendent is directly responsible to the superintendent 
for the work of instruction in all the grades, elementary and high school. 
She is the director of the curriculum revision program and helps to inte- 
grate and codrdinate the work of the system. 

Working on call of principals, special supervisors, teachers, and pupils, 
the assistant superintendent tries to give the help needed at the time it 
is requested, whether it be to stimulate, to encourage, to evaluate work 
done, to help in the solution of some baffling problem, to secure needed 
materials, or to make suggestions as to the next step. 

It is no uncommon thing. for pupils to call on the assistant superin- 
tendent for help in their group work. One class preparing to leave the 
grade school to go to high school wrote and requested her to come and 
discuss with them plans for their work in high school the following Sep- 
tember. This year, each group coming into the high school in the fall 
was visited; plans were discussed with the pupils for their work. They 
entered school in September knowing what units were offered and what 
group they wished to join. 

A boy from the senior class in one of the high schools met the assistant 
superintendent in the hall the second week of school and asked her to 
visit his class to make some suggestions about the year’s work. More and 
more students in every grade are recognizing her as another source of 
help and are asking her assistance whenever needed. In this way the 
children also are having a share in the development of the Raleigh educa- 
tional program. 

SpeciaL SuPERVISORS 

Special supervisors of physical education and music work with the staff, 

giving training to those teachers needing this work and guiding and 
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directing the work of the system in these fields. They work with the 
curriculum groups developing the course of study in these subjects and 
directing the work of setting up a program in music and physical education 
for the schools. They work on call of principal and teachers, giving 
expert help where needed, and they do classroom visiting with some 
demonstration teaching. 

PUBLICATIONS 


In addition to the publications of the Council, bulletins have been 
issued by the system on different curriculum problems at various times. 
These are not to be used as a course of study to be followed, but are a 
record of what has been done and are suggestive to teachers in planning 
their work. 

EVALUATION OF THE PRoGRAM 


The assistant superintendent’s plan of work on call of the principals 
and teachers has worked well with the teachers reached. Because of 
limited funds to employ assistants and clerical help, it is not possible to 
reach every teacher as promptly as might be desired. 

The special supervisors are not always able to see the program as a 
whole, and each one is apt to want to put too much emphasis on his special 
subject. Growth has been noted in this work, however, and it is believed 
that the plan will prove satisfactory. 

The principals give too much time to detail work. Some of this group 
do full-time teaching and are not able to spend as much time in the 
classroom as they would like. No clerical help is provided for them, but 
much of the detail work could be delegated to teachers and some might 
be left undone without injury to anyone. The fact that more time is 
given to the administrative than to the supervisory phase of the work 
is probably because principals know more about it and find it easier to 
do than the classroom work. 

The Materials Bureau is not adequate to meet the needs of the staff 
at present. It is growing, however, and after a drive on this work during 
the present year, with a part-time assistant, progress should be made. 
Provision must be made for the constant growth and upkeep of this 
Bureau. 

The teachers do not as a rule keep as careful records as are needed. 
This is partly due to heavy teacher load and consequent lack of time, and 
partly because the principal and the assistant superintendent cannot give 
the individual teacher the time needed to help her with such records. 
Very complete teacher and pupil records are necessary if any adequate 
check on the work is to be made. 

Teachers coming into the system must first be given the point of view 
held by the Raleigh staff. They come out of the teacher-training institu- 
tions frequently with an excess of method courses and a minimum of 
content courses in the subjects they expect to teach. Consequently, be- 
cause of their lack of training in subject matter, they are unable to 
develop a unit of work as fully as they should, thus causing the pupils 
to miss many valuable experiences. 
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It is not always possible to get college extension courses to meet this 
need, so it is necessary for the assistant superintendent to give much time 
to that phase of the training of teachers in service which is concerned 
with helping the teacher to know what to teach. 

The Raleigh program has resulted in very real growth of the staff: 
in professional attitude and spirit; in a clearer conception of educational 
objectives; in ability to analyze situations, recognize problems, and plan a 
nethod of attack; in the desire for more training; in the ability to free 
themselves from the traditional course of study and to maintain an 
experimental attitude toward the work; in a happier attitude; in interest 
in evaluating and measuring the growth of the pupils and the worth- 
whileness of the program; in a wholesome atmosphere in the classrooms 
that encourages the pupils to seek opportunities for self-expression along 
many lines; in the development of the creative talents of the teachers. 


Case No. 5—-A DESCRIPTION OF THE SUPERVISORY PROGRAM 
IN THE KINDERGARTEN AND PRIMARY GRADES OF THE 
SAN FRANCISCO SCHOOLS, 1923-1929 


JuuiA LerHetp Hann 
Director of Primary Education, San Francisco, California 


Truly the proof of the pudding is in the eating, and one way to evaluate 
a supervisory program is through a description of its progress as it affects 
the growth of children and teachers. 

The following pages describe the reorganization of the work in the 
kindergarten and primary grades of the public schools of San Francisco 
over a period of six years. The program was evolved from certain funda- 
mental principles but was not, of course, foreseen in its entirety in the 
beginning. The situation made its own demands. 


LAUNCHING THE ProgRAM 

In the fall of 1923, the Kindergarten-Primary Department was con- 
cerned with supervision of 46 kindergartens and 430 first and second 
grades; about 476 teachers in all. 

The first step was to get acquainted with the situation. Considerable 
classroom visiting showed the supervisor that, although there was much 
to be done, it would be undesirable to attempt any changes without a 
tryout of newer methods and a comprehension and appreciation of the 
newer educational theory and practice on the part of teachers and prin- 
cipals. 

Tryout Schools. Three schools were, therefore, chosen as “tryout cen- 
ters.” They were selected because of the type of district and the willing- 
ness on the part of principals and teachers to undertake changes that 
might seem desirable as the work proceeded. The same teachers remained 
at the schools. A majority of them were experienced teachers who had 
always secured acceptable results in subjects in the more formal procedures 
to which they were accustomed. All restrictions of existing courses of 
study were lifted in these three centers and it was agreed that any changes 
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could be made that seemed worthy. Supervisors of music, art, and physi- 
cal education withdrew their courses of study and ceased to visit the 
classes in these schools in a supervisory capacity. 

Demonstration Teaching. Because of a sweeping change in educational 
administrative organization and leadership, which had been accompanied 
by considerable unpleasant political activity, some of the teachers were 
on the defensive, afraid that something might be asked of them which 
they could not do. It was necessary for the supervisor to relieve the 
tension by doing in the beginning all the demonstrating herself. Sub- 
stitutes were put into the classrooms in these centers, and principals and 
teachers in the kindergarten and Grades I, II, and III in each school saw 
the supervisor demonstrate certain aspects of the work on each level. 
For example, one day they would all visit each grade from kindergarten 
through Grade III and see how each level contributed to a love for 
good books, how the beginnings of music developed through the grades, 
or how the luncheon period can best be handled in each grade. Each 
demonstration was followed by a conference in which there was frank 
criticism. Headings were suggested as different problems arose. Both 
intelligence tests and oral and silent reading tests were given to the pri- 
mary classes in the beginning. 

Introduction of Flexible Program. A flexible daily program with longer 
periods of work was put into operation. A writing system previously fol- 
lowed in all grades was adapted to little children. A procedure resulted 
which did not establish habits contrary to the arm movement required 
in the upper grades but which eliminated the formal drills, the letter 
analysis of words to be written, and substituted free large writing of 
word wholes on large unruled paper. Wrapping paper was used for the 
daily writing as it could be cut the necessary size, which varied according 
to the use that would be made of the product. For example, a sign might 
be needed for the door—IN—or a sentence might be needed for the 
invitation to the puppet show—COME TO OUR SHOW. It took the 
teachers so long to cut the paper that we found it desirable to have the 
rolls cut at the factory in four-inch and six-inch widths. The teachers 
could then quickly unroll the lengths required. A standard cutter was 
furnished for each width, so that the paper could be quickly torn to suit. 

No one reading method was adopted. Various approaches to reading 
were tried, much of the work type of reading connected with classroom 
activities being encouraged, the school newspaper, etc., as well as a variety 
of reading table material. Phonetic analysis was subordinated to thought 
and the amount greatly reduced and put further along in the progress 
of reading. Many single copies of readers, picture books, etc., were put 
on attractively placed and covered reading tables, and individual library 
work was encouraged. 

A free work period was put into the day’s program and many large 
and adaptable materials were added to the classroom equipment. 
Screwed down desks were moved into the hollow square formation and 
as many discarded as possible. Old benches were brought in from the 
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playground and fitted with vises for wood work. Kalsomine paint was 
furnished to each class. At first there were no painting easels, making 
it necessary to use large pieces of wallboard (2’ x 6’) on the chalk rail 
and to fasten the large sheets of unprinted newspaper upon them with 
clothespins. Empty cardboard cartons, wooden boxes, large rolls of 
wrapping paper, and other bulky materials appeared in the rooms. At 
once, it became imperative to have a consultation concerning ways and 
means for keeping things in some order. Bins for holding the larger 
products were devised and constructed in the Manual Training Depart- 
ment of a nearby school. The first bin was changed whenever improve- 
ments seemed possible. An open rack on rollers, similar to those used 
in hotels for linen or in the dining-rooms for trays and dishes, was devised 
and found to be highly satisfactory for daily use by the children. These 
racks were open all around and had three shelves. They were immediately 
designated by one of the children as “help-yourself tables” and were used 
for the different materials which varied from day to day according to the 
problems at hand. 

Common orange crates were transformed by the children into individual 
cabinets, and curtains for these were made and decorated by the children. 
The first collection of tools was, indeed, a motley one, but as soon as 
possible good tools in limited number were secured. Paint brushes of all 
kinds were tried out and finally a type of long-handled brush and several 
sizes of finer camel’s-hair brushes were chosen. All of these were fur- 
nished in limited quantities. 


EsTABLISHING THE PRoGRAM 


Several months were spent in preparatory demonstration work. In 
January, 1924, the three schools were ready for visitors. The teachers 
and principals in these schools believed in the program, for they had 
helped make it. 

Visitation at the tryout schools. There was great curiosity throughout 
the other schools as to what was going on, for the three schools had been 
closed to visitors during the process of change. Principals of all the ele- 
mentary schools were invited in small groups to visit the centers. They 
spent days here and demonstrations were given for them. The visitors 
were always taken through the entire grade span in order that they might 
see growth on each level. 

Visiting days were then scheduled for teachers throughout the city, 
substitutes being furnished for their classes. Again, all the teachers, visit- 
ing in small groups, saw the work in each grade and were made sensitive 
to advancing standards. By this time, the teachers in the centers felt 
sure enough of themselves to be willing to do their own demonstrating. 
Discussions always followed the visits. 

From the beginning, university and teachers college extension courses 
were given by the supervisor. A large number of teachers and principals 
availed themselves of the opportunity to build up the background neces- 
sary to undertake the work. Demonstration lessons were also given in 
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connection with these evening courses and, although the situations were 
somewhat artificial, the results were gratifying. Frequent exhibits of the 
crude work of children were held in connection with these classes and 
individuals and groups of teachers were stimulated to attack problems of 
adaptation and evaluation in their classrooms as a part of the work for 
the course. 

Teachers who visited the “centers” and who wished to try out many 
of the changes seen were permitted to do so, but they were urged to go 
slowly. One of the supervisor’s most difficult problems was to keep some 
teachers from making too rapid changes with too meager a background 
of understanding. 

Children in the “tryout centers” were re-tested in October, 1923, and in 
May, 1924. The results showed that the so-called fundamentals had not 
been neglected under the changed conditions. 

In June, 1924, Grade III throughout the city was added to the super- 
visory unit. The work spread into many schools. Group meetings were 
held whenever a particularly good piece of work was discovered. This 
also stimulated the spread of the movement. 

Building the course of study. At the end of this year a committee of 
principals and teachers was appointed to formulate the course of study. 
Several of the teachers and principals from the tryout centers were in- 
cluded in the committee. The supervisor was elected chairman. A com- 
mon background of experience made it possible to build a curriculum 
flexible enough to meet varying conditions. The new unified course for 
kindergarten and primary grades covered all the work. The special sub- 
ject supervisors were asked to serve in an advisory capacity only. The 
whole educational process centered on the child and the things that he 
could not afford to miss. The course of study was completed by the com- 
mittee during the summer and was printed and in the hands of the 
teachers by the opening of the fall term. 

Adaptation of rooms and equipment. Adaptations in room arrange- 
ments, furniture, equipment, and supplies were necessary as soon as the 
course was adopted. A $12,000,000 bond issue for new school buildings 
made it possible for us to look forward to some kindergarten and primary 
rooms built to meet the needs of young children. Since time must elapse 
before these buildings could be completed, changes had to be made in 
existing schoolroom surroundings. 

Although some of the classrooms for Grade I were equipped with chairs 
and tables, practically all of the classrooms for Grades II and III were 
furnished with desks screwed to the floor in rows. It was impossible to 
remove all desks and replace them with chairs and tables. Adaptations 
in the form of a hollow square and the removal of all extra desks were 
made, thus providing as much free space as possible. Two tables were 
furnished to each room for “help-yourself tables.” As rapidly as possible 
fifteen chairs were added to the primary rooms for group work. Dis- 
carded science tables from one of the high schools were cut down to the 
proper height for work benches. An enterprising kindergarten teacher 
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invented a low work bench for the use of kindergarten children. Old tables 
and benches of various kinds were adapted also. 

In the fall of 1924, when the new unified course of study was ready, 
monthly meetings and demonstrations were begun for principals in one 
group, experienced teachers in another, and new or probationary teachers 
in another. In each case the groups saw demonstrations in the other 
kindergarten and primary grades as well as in their own. Such confer- 
ences and demonstrations were continued throughout the six years. 

Program of open house days. Open house days were held frequently in 
different schools. All of the lower grade classrooms in a school would be 
open to visitors on a certain day. Teachers might choose to substitute 
such a visit for their regular visiting day, which had often in the past 
been merely a visit to a friend’s classroom with no end in view and no 
outcome except, perhaps, imitation of the poor things seen as well as of 
the good. One of the most significant aspects of the program was seen in 
these open house days, for every teacher did for the visitors something 
that she could do best. Even a teacher of only a few weeks’ experience 
would exhibit her work to the visitors. Mimeographed copies of a pro- 
gram of what could be seen in each classroom were distributed at the door 
and the visitors chose their locations to visit. A conference was always 
held afterward and the teachers who demonstrated participated in the 
discussion. Sincere evaluations were made and the attitude toward doing 
demonstration work was very gratifying. It was not uncommon for prin- 
cipals and teachers to call up the central office and ask when such a 
meeting or demonstration could be held in their schools. The teachers 
felt that the demonstrations were helpful to both demonstrator and visitor. 
Principals considered them a splendid stimulus to the improvement of 
school work and to the esprit de corps. 

New buildings and equipment. The new buildings have every facility 
for the work of young children, since they were built to meet the needs 
of the activity program. Kindergarten and primary classrooms were built 
with an adjoining alcove—a space previously used for a coat room— 
enlarged a little to make it suitable for a work corner. A low sink was 
installed in each alcove. The work bench and painting easels were put 
here. The walls of the alcove were covered with cork pinning board. The 
back wall of the classroom and the upper portions of the other black- 
boards were also covered with cork. Individual cubicles for each child 
were set into the walls of the classrooms—36 per room. Wherever neces- 
sary, the storage equipment was supplemented with movable bins? 


EVALUATION OF THE ProcRAM 


Classroom tryouts, experiments, and evaluations have formed a major 
part of the reorganization program. Independence in committee and 


3A detailed description of these rooms can be found in: Furnishing the Set- 
ting for an Activity Program in Kindergarten and Primary Grades, Board of 
Education, San Francisco Public Schools; or Davis, Mary Dabney, “Plans and 
Equipment for Nursery, Kindergarten and Primary Education.” Washington: 
Bureau of Education. ' 
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curriculum work was a matter of slow but positive growth. Teachers had 
to perfect new techniques to fit the new philosophy and until they did 
that they were not confident of their ability to set new goals and to 
evaluate outcomes for changing procedures. Some examples of classroom 
committee work will illustrate the kind of progress that was made, al- 
though there have been so many studies that it is impossible to mention 
them all. 

Records by pupils. A large number of teachers experimented with the 
participation of children in record keeping. It was found that even kinder- 
garten children liked to mark their own attendance. A long strip of 
wrapping paper, divided into one inch squares, was used. Each child’s 
name was printed at the left and the child put a cross for his attendance 
each day. At the end of the week and sometimes at the end of the 
month the child summarized the facts concerning his attendance. A few 
kindergarten teachers found the older kindergarten children interested in 
marking a large chart for accomplishments in the work period. Most of 
the teachers, however, felt that a group conference with the children, in 
which work was evaluated partly by the group and recorded on cards 
by the teacher, met their needs best at this stage. Primary teachers 
tried various kinds of records. Library choices were sometimes recorded 
in group charts and sometimes on individual charts or mimeographed 
sheets. The children of Grade I were often interested only in making a 
check mark beside the name of book or story read. Children of Grade III 
were often able to write a simple review of the story or book, telling 
perhaps why the story was enjoyed and giving some interesting facts 
about it. Such habits as being patient, speaking English, being good 
housekeepers, finishing what you start, etc., were checked by the children 
in various situations. 

Pupil selection of stories and pictures. The teachers of one group used 
their own classroom situations in trying to find what stories children like 
at different age levels. Another group made a study of pictures children 
liked best. Another endeavored to determine the stages in the develop- 
ment of the use of clay. 

Incidental number experiences of pupils. During one month all of the 
teachers kept a record of incidental number experiences of the children. 
Compilation of results led to the belief that young children come to 
kindergarten with much more number experience than reading readiness. 
A basis for the determination of —' levels in number experiences was 
furnished by this study. 

A group of teachers made a study of room arrangements with movable 
furniture. Eye specialists were consulted as to proper lighting, and the 
help of the Board of Health, the Fire Warden, and others was asked. 

Controlled experiments. Controlled experiments were carried out with 
several beginning classes in Grade I to evaluate different approaches to 
reading. 

A suitable lesson plan was developed each year by a committee of 
teachers. The plan sheet was revised each spring and printed for the year. 
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Collections of original poems and songs were made from the different 
schools. Much experimenting was done with song making. 

A committee collected kalsomine paintings from each school and pre- 
pared a bulletin giving desirable points in the children’s criticisms of 
paintings for each level. Stenographic reports of children’s discussions 
of their paintings were used as a basis for selection of these standards. 
Much reading was done also. 

There was no suitable scale in print for the measurement of the large 
writing of children. A method was devised for using classroom writing 
for a scale in each room. Specimens of writing were also collected and 
displayed by districts, and standards of achievement for each level deter- 
mined roughly. 

Junior primary classes were established in many schools for children 
who were chronologically old enough for Grade I but not ready for read- 
ing. Careful records are kept of the growth in reading readiness as well 
as other aspects of development. An attempt was made to determine 
the best possible program for these children. 

Units selected for publication. Since 1923, freedom in the choice of 
activities has led to a wide variety of units of work. Mimeographed 
copies of many such units have been distributed to the schools, not to 
be copied exactly in other situations, but as suggestive of possible develop- 
ments. An evaluation of units of work was begun by a committee in the 
spring of 1928. Teachers throughout the city were asked to submit 
accounts of the most successful activities. These naturally fell under 
certain groupings and were classified in a bulletin under the title “Home 
and Related Activities, Community Interests, Transportation and Com- 
munication, Country Life and Life in Other Lands, with Much Attention 
Paid to China, Japan, Russia, Honolulu and Africa.” Actual questions 
asked by children were included, as well as complete bibliographies for 
teacher and children. In order to insure some growth from level to level, 
a unit such as the playhouse was described as it had been carried out by 
different groups of children ranging from the four-year-old group in the 
kindergarten to the children in Grade III. 

The following bulletins have been published during this six year period: 

1. A Unified Course of Study for Kindergarten and Primary Grades, 
1924. Reprinted with slight revisions in 1925, 1926, and 1927 

2. Furnishing the Setting for an Activity Program, April, 1927. Re- 
printed in 1928 

3. Self-Directed Activities for Primary Grades, 1927 

4. An Activity Program in the Social Studies, August, 1929 

Many studies in mimeographed form supplemented these printed bul- 
letins. 

As the work grew, and as many of the older teachers retired because 
of a new pension law, the problem of large numbers of new teachers 
pressed upon us. In 1929, three helping teachers assisted the di- 
rector of kindergarten and primary grades in extensive guidance of new 
teachers. 
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Worx or Supervisors AND HELPING TEACHERS 


Supervisors of music, art and physical education have acted throughout 
as advisory experts upon request of teacher or principal. They do not 
teach the children nor specify the course of study in their subjects. They 
contribute to meetings of the kindergarten-primary department upon 
invitation. In this way, the classroom work is in the hands of the teacher 
and the children. There is no conflict of point of view or authority. 

Principals use a requisition blank, specially devised to request the 
assistance of helping teachers. These requests are filed and granted as 
quickly as possible. The principal or teacher requesting help states the 
kind of help needed. After the visit, helping teacher and principal esti- 
mate the frequency of return visits needed. 

Helping teachers visit, for the most part, the probationary teachers and 
assist them by demonstrating, by helping with the organization or reorgan- 
ization of the room into such units as will make the work most satis- 
factory for the children, or in whatever other way the teacher wishes 
help. Thus, opportunity is given for an informal supervision; the helping 
teacher secures an intimate acquaintance with the problems of each class 
and is better able to assist the teacher in making adjustments and securing 
responses. 

The probationary teachers feel that, at any time they may ask, a helping 
teacher will be ready to conduct a demonstration lesson. Weekly con- 
ferences are held and demonstration lessons are given. Conference hours 
are also provided, at which time the teachers bring their individual prob- 
lems or requests. 

The most important function of the helping teacher is to stimulate 
and assist probationary teachers that they may make the most wholesome 
growth of which they are capable. 


CoNCLUSIONS 


The following convictions held by the supervisor at the beginning of 
this reorganization have been strengthened as the program developed: 

1. That a reorganization of curriculum and method must be based upon 
classroom experience; that tryouts should precede the making of new 
curricula; and that a background of theory must accompany these prac- 
tical changes. 

2. That independent thinking, initiative, and codperation, so carefully 
cultivated in children in the modern school, must be stimulated in teachers 
also, and that in many cases this is difficult for teachers because of years 
of experience in practices based on a different philosophy. 

3. That suitable furniture, equipment, and supplies can be expected to 
evolve in the process of change; that the activities in the classrooms 
furnish the force to effect desirable changes, provided the administrative 
machinery moves readily in securing such materials when their worth is 
proved. 

4. That the accomplishment of an activity program does not mean 
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lowered standards but broadened and deepened ones; not less learning 
but more; not license but greater self-control through practice. 

5. That the teacher and children must be protected from a conflict of 
authority and from conflicting points of view. The program requires 
understanding and coéperation of administrative, supervisory, teacher, and 
pupil agencies. 

6. That an evaluation must be made of the total effect of the program 
on the total personalities of children and teachers and that the measure- 
ment of subjects constitutes only one part of the evaluation. 

No attempt has been made in this account to outline method and 
curricula. The publications of the department will provide that informa- 
tion to any who are interested. 

Certain developments peculiar to this system which would not be com- 
mon to all are: 

1. The teacher-training phase of supervision was necessarily large here. 
The retirement law caused an unusually large turnover among teachers 
and principals, especially among primary teachers. The new teachers have 
been a challenging problem, but they have made rapid progress. 

2. There was greater need for direct dealing with teachers because of 
the varied training of principals and their greater familiarity, in most 
cases, with the work of the upper grades. 

3. The director had administrative as well as supervisory authority in 
her field. The administrative organization of schools provided for a 
deputy superintendent in charge of both administration and supervision 
of high schools, a deputy superintendent for junior high schools, one for 
special schools, and another for intermediate grades. The director of 
kindergarten and primary grades was given the same authority as a deputy 
for those grades. 

4. Much more teaching was done by the supervisor in the classroom 
than would be necessary under most conditions. 

5. The bond issue for new buildings and the splendid codperation of 
the architect in plans for classrooms for the lower grades to meet the 
needs of an activity program were quite unusual. 

6. From the beginning, there was a nucleus of experienced teachers 
eager to chaage, and the freedom, lack of conservatism, and wholehearted- 
ness of the western temperament made progress rapid when the way was 
opened for it. 

There are many problems in supervision of a modern program of work 
still unsolved, but the future promises the solution of many of them in the 
classrooms of public schools. Probably the most crying need from now 
on is that for broader and deeper knowledge on the part of teachers. Both 
teachers and pupils have learned to think, have developed much of the 
creative element in themselves, have perfected many techniques, but the 
training of teachers of the future must include a larger fund of knowledge 
and a broader comprehension of world problems, including those of their 
own country. 
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GENERAL COMMENTS ON CASE STUDIES 


These case studies reveal certain common elements which are 
of primary importance to everyone who is making or evaluating 
a supervisory program: 

1. In every case the supervisor who was asked to report has 
been working hard in her position for six years or more. This 
implies that a supervisory program can not be brought to full 
fruition in a short period of time. It is a long and sometimes 
tedious period of careful planning and painstaking care for im- 
portant details that produces a supervisory program which comes 
to be nationally known for its success. 

2. Each of the programs was a cooperative enterprise. In no 
case did the supervisor sit down in her office chair and evolve 
a program of supervision which she then attempted to “put over” 
on the principals and teachers with whom she was to work. 

3. In all of the city school systems it was accepted that the 
elementary principal was the person solely responsible for the 
success of the instructional program in his school. Supervisors 
were always helpers and advisers, never commanders. 

4. In all cases the supervisory program included a concerted, 
codperative attack by principals, teachers, and supervisors upon 
the problems of curriculum revision. There are two possible 
interpretations of this fact: it may reflect the current emphasis 
upon this phase of educational endeavor; or it may indicate 
one of the surest and best ways of producing the awakening and 
growth of principals and teachers which is bound to result in a 
greatly improved program of instruction. 

5. In most cases there was carefully planned publicity, the 
object of which was to arouse the interest of both parents and 
teachers in improved methods and materials of instruction. 

6. In some cases it was necessary or desirable to change the 
arrangement and equipment of classrooms in order that the new 
programs might be carried on with full success. 

7. Most of the supervisors found it desirable to organize 
coérdinating or clearing-house committees in order to guarantee 
that the program should be thoroughly and adequately inte- 
grated, that the system might make progress as a whole and not 
in an uneven progression of unrelated parts. 

8. In all cases supervisors found it necessary to initiate a 
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program of testing and checking that they might have the 
greatest possible amount of objective evidence of the strengths 
and weaknesses of their projected programs. 

In addition to the common elements found in successful pro- 
grams of supervision, the reader will note that each of these 
supervisors found it necessary to attack and solve problems of 
a purely local significance: 

1. In rural Wisconsin the supervisor found it necessary to go 
about making addresses at county institutes and was able to do 
little objective testing because of lack of funds provided for 
this purpose by the state. 

2. In San Antonio more than 50 per cent of the pupils in the 
elementary schools came from homes in which English was not 
spoken. The development of a direct method of teaching English 
was one of the most important and difficult phases of the super- 
visory program. 

3. In Dayton the proximity of good schools of education made 
it possible to use a system of extension courses in the training 
of teachers and principals. 

4. In Raleigh the development of professional library and 
materials bureaus was a unique means of solving a. difficult 
problem which is found in Raleigh and in many other cities. 

5. In San Francisco the attempt to make rather a sudden 
change from a formal, traditional program of elementary school 
instruction to a program in which the emphasis was on activities, 
projects, and units of work made it a practical necessity to 
develop “tryout centers” in which these more progressive 
methods could be demonstrated and illustrated, and which 
would serve as training schools for those who were to become 
the teachers of other teachers and principals. 

From these case studies of supervision in practice it is safe 
to conclude that there are certain general principles and prac- 
tices which will help to guarantee the success of any supervisory 
program, but that each school unit will almost certainly have 
its own peculiar local problems which will require unique treat- 
ment and solution if the supervisory program is to be fully 
effective and successful. 











CHAPTER IX 
SUMMARY AND CONCLUSIONS 


THE YEARBOOK AS A COOPERATIVE ENTERPRISE 


This yearbook is really a coéperative enterprise. The com- 
mittee sought the codperation of the membership in providing 
information upon which to base certain chapters. Furthermore, 
the committee has planned and is here submitting a report rep- 
resenting the consensus of opinion and not merely the opinion of 
the individual members comprising the committee. 

While the writer of this chapter thoroughly believes in making 
the yearbook a codperative enterprise as outlined in the preface, 
he feels that two general statements concerning the codperation 
are warranted: (1) there is need for greater participation on the 
part of the membership; (2) a special section of the yearbook 
should be set aside for allowing individual members of the com- 
mittee to set forth any outstanding dissentient views which they 
may have on any ideas presented in the yearbook. 

Little discussion of the two enumerated points is needed. The 
committee, while keenly appreciative of the codperation given 
by the membership, feels that more than seventy-seven out of 
approximately fifteen hundred members should have responded 
to its call for information concerning investigations, projects, 
and case studies. It may be that no large percentage of the 
membership was engaged in such activities, but as a matter of 
general principle the committee ventures to suggest to the mem- 
bership that greater participation in the preparation of the year- 
books and in the activities of the Department will insure 
better yearbooks, the development of a better department, 
and a maximum professional growth on the part of those 
participating. 

The committee also realizes that the presentation of a report 
subscribed to by all members represents the common elements 
in the thinking of the committee and has a standardizing effect 
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in the field under consideration. However, it also realizes that 
variation in thinking is essential to progress and stimulates ex- 
perimentation rather than standardization. Thus the committee 
feels that many valuable suggestions, not in conformity with 
group thinking, are lost and it ventures to advise that in the 
preparation of future yearbooks space should be provided for 
allowing individual members of the committee with ideas widely 
differing from those approved by the group to make presenta- 
tions. Such a provision would have been appreciated by the 
membership of the present committee and would have facilitated 
somewhat the work of the chairman. To illustrate, Chapter II 
contains statements which different members accepted with reser- 
vations. The writer is of the opinion that provision should have 
been made for any member to register any decided opinion not 
acceptable to the group on the issues under consideration. 


NEED FOR EVALUATION OF SUPERVISION 


In Chapter I of this yearbook, the needs for the scientific 
evaluation of supervisory activities are set forth. In emphasiz- 
ing the difference between description and evaluation, there is 
a subtle but significant suggestion that in some of the previous 
attempts at the evaluation of supervision or in experimental 
procedure in general no differentiation in the terms has been 
made. The significance between the two terms is also empha- 
sized in Chapter II. In each of these chapters it is pointed out 
that there may be agreement on the facts of description or the 
facts of measurement, but great disagreement on the interpreta- 
tion or evaluation of the facts. Both chapters also emphasize 
the fact that in the last analysis evaluation is dependent upon 
standards of value derived from accepted beliefs or philosophies, 
and stress the necessity of formulating a philosophy of educa- 
tion before attempting an evaluation of supervision. The pres- 
ence of various philosophies of education complicates the prob- 
lem of evaluating supervision but nevertheless stresses the need 
for such evaluation. Other factors which complicate the prob- 
lem of evaluation but at the same time emphasize its need are 
also enumerated. Such factors include the variation in the types 
of supervisory organization, the size of the systems in 
which the supervision is being done, the multiplicity of tasks 
which supervisors are called upon to perform, and the attitude of 
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administrators, teachers, and laymen toward it. It is subtly 
hinted that the attacking of the problem of evaluating super- 
visory activities is most timely because of the lack of proper 
evaluation in the past, the development of a spirit of scientific 
experimentation among the leaders of the profession, and the 
demands for financial economy in the administration and super- 
vision of schools. 


Tue CRITERIA FOR THE EVALUATION OF SUPERVISION 


In Chapter II the committee suggested three criteria which 
should be taken into consideration in the evaluation of super- 
vision: effects, activities, and characteristics of the supervisor. 
Since in evaluating effects it was agreed that consideration 
should be given to effects on the pupils, teachers, parents, com- 
munity methods of teaching, and subject matter, the committee 
states that this factor should have major consideration in deter- 
mining the value of supervision. It also feels that supervisory 
activities, i.e., the type of activities in which the supervisor 
engages, are of considerably less importance than the effects pro- 
duced, but that they must have consideration until more ade- 
quate measurements can be made of effects produced. It was 
decided to list the characteristics of the supervisor among the 
criteria, although the acceptance of this as a criterion was rather 
lukewarm, and it was agreed that it should be given little 
consideration in the final evaluation. 

In stating the criteria for evaluation, the committee empha- 
sized the fact that each school unit must of necessity set up its 
own standard of values based upon its accepted philosophy of 
education, but a sample set of values is presented to illustrate 
to those desiring to evaluate supervision the type of standards 
to be formulated. The necessity of deciding on a given set of 
weights for the various items involved was emphasized. Here 
again it was stressed that the weights assigned in any school 
system depended upon the philosophy of education prevailing 
within the system. 

The readers of this yearbook may criticize it for not setting 
up definite standards of values to be universally employed in the 
evaluation of supervision, but a little deliberation on their part 
should convince them of the disastrous effects which might re- 
sult if the committee had assumed for the moment that it had 
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such supreme confidenee in its knowledge and insight as to dic- 
tate for the country at large the swmmum bonum of supervision. 


ScIENTIFIC PROCEDURES IN EVALUATION 


A very concise and adequate statement of the procedures in- 
volved in scientific investigation is set forth in Chapter IV. 
This is a general treatment, but it is believed that all super- 
visors and others interested in educational experimentation can 
profit from reading this chapter. After setting forth the general 
characteristics of scientific method and presenting a general dif- 
ferentiation between pure and applied science, the author of the 
chapter sets forth a rather unique distinction between the two 
types of research. According to the statement given, pure sci- 
ence is a quest for relationships, usually to be expressed as a 
law; applied science, a quest for determining the better of two 
methods or materials. It is implied in the discussion that in 
pure research the discovery of truth is the major interest, while 
in applied research the major interest is the discovery of truth 
as a basis for maintaining status quo or for making changes of 
some type or other. According to the hypothesis made, applied 
research in supervision is conducted for the purpose of justifying 
existing practices or for providing a scientific basis upon which 
to make changes in the activities involved. 

The major phases in the scientific evaluation of supervision as 
pointed out are: (1) adequate delimitation of the problem under 
consideration; (2) choice of and weighting of the criteria upon 
which an evaluation is to be made and provision for adequate 
measurement; (3) control of all the significant variables except 
the one supervisory factor whose effect is to be measured; and 
(4) organization and interpretation of the results obtained. In 
discussion of these characteristics, especial emphasis is placed 
upon the necessity for applying the law of a single variable in 
the attempts to evaluate supervision and upon the use of “com- 
mon sense” in the interpretation of statistical results. Accom- 
panying this discussion of the characteristics are brief discus- 
sions of the methods used in the collection of opinion—the inter- 
view, the questionnaire, and the jury—and the two methods for 
the collection of facts—observation or case study and experi- 
mentation involving one group, equivalent groups, or rotating 
groups. Comments are offered on both the advantages and 
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disadvantages of each of these procedures..While the value of the 
results obtained through the use of the various methods is recog- 
nized, the final plea is for the use of carefully planned and re- 
peated experimentation. 


TECHNIQUES EMPLOYED IN THE EVALUATION OF SUPERVISION 


A survey of the literature dealing with the evaluation of va- 
rious phases of supervision or supervisory agencies reveals that 
all of the various methods enumerated in the previous sections 
have been employed. In the discussion of the techniques used 
in the available experimental studies, the studies are classified 
according to the use of the following methods: questionnaire, 
jury, interview, case study, experimental groups, equivalent 
groups, score card, and comprehensive experimentation. This 
classification, while apparently somewhat different from that in 
the previous chapter, is in reality not a modification but only 
an elaboration of the previously enumerated types. 

A perusal of the chapters on techniques employed shows a 
gradual evolution in scientific procedure from that employing 
the use of general questionnaires to that employing the highest 
of refinements in experimental procedure. This is a natural evo- 
lution which must be expected. Furthermore it must be ex- 
pected that those engaged in the evaluation of supervision, be- 
cause of variation in type of training and educational develop- 
ment, will continue to employ methods representing various 
stages in the evolution of experimental technique. The early 
studies used to a very great extent the questionnaire. Usually 
it was general, poorly constructed, and the results were crudely 
handled. Gradually, however, questionnaires becames refined 
and the methods of tabulating the data were improved and elab- 
orated. The questionnaires, instead of being general, became 
specific, asking about a particular thing or a particular person. 
More discretion was employed in determining to whom they were 
to be sent, in controlling the type of responses, and in tabulat- 
ing the answers received. Coincident with the studies involving 
these improvements, investigations appeared involving such 
modification of the questionnaire technique as: the interview, the 
jury, or the case study. Almost simultaneously with the im- 
provement in questionnaire technique appeared the experimental 
investigation, which at first involved loosely-controlled variables, 
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inadequate statistical treatment and interpretation of results. 
Recently a few studies have appeared with controls involving 
the application of the law of the single variable, adequate statis- 
tical treatment, and “common sense” interpretation of the re- 
sults. 

Many of the studies reviewed can not meet the standards of 
scientific method outlined in Chapter III. They fail to meet 
these standards in that the questionnaire technique is faulty; 
the treatment of the data, crude; the control of all factors, ex- 
cept one, impossible; the amount of data and instruments of 
measurement, inadequate; or the interpretation of the data, ques- 
tionable. While the conclusions reached in such studies may 
not be irrefutable, the studies themselves represent a contribu- 
tion in that they—as their inadequacies have become evident— 
have had the effect of stimulating and encouraging the develop- 
ment of refined experimental techniques which give promise of a 
new day in the scientific evaluation of the effect of supervision. 


TECHNIQUES IN PROJECTS AND CASE Stupiers REPORTED BY 
SUPERVISORS 


The experimental techniques employed in most of the investi- 
gations reported by the members of this organization as reported 
in Chapters IV, V, and VI are for the most part somewhat in- 
adequate to the purpose at hand. The problem under consid- 
eration in the majority of the reports submitted was worth 
while, although in most cases the variable under consideration 
was not supervision per se or any aspect of supervision. In- 
stead, the variable was a method of teaching or a method of 
learning. However, assuming the variable was satisfactory, the 
controls over other variables, the instruments of measurements, 
or the method of handling the data obtained were often inade- 
quate to warrant reaching any reliable conclusions. While this 
type of experimentation, even with all of its faults, has great 
value in the stimulation of professional growth and advance- 
ment among teachers and supervisors, the fact still remains that 
anyone who reviews these studies will be convinced that, if the 
investigations reported are representative of the best efforts at 
experimentation, there is a real need among the membership 
of the Department for training in experimentation and in the use 
of experimental techniques. 
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FINDINGS FROM THE INVESTIGATIONS 


The general conclusions which seem to be warranted by the 
numerous investigations undertaken for the evaluation of super- 
vision and supervisory activities are that supervision is effec- 
tive in furthering growth in pupils, that supervision resulting in 
superior growth in the pupils has had its effect in changing 
teachers and teaching procedure, and that supervisory activities 
differ in their relative effectiveness. Approximately thirty in- 
vestigations (questionnaires, experimental studies, and studies 
based on cumulative records) provide the basis for the first con- 
clusion; twelve studies, involving the use of the questionnaire, 
case study, accrediting juries, and score cards, and approxi- 
mately an equal number involving experimentation and measure- 
ment, provide the basis for the second conclusion; five experi- 
mental studies provide the basis for the third conclusion. The 
findings from these five studies may be stated as follows: that 
the supervisory conference following a supervisory observation 
of teaching produces improvement in teaching which can clearly 
be seen at the next observation of teaching; that supervisory 
time devoted to personal conferences tends to be more effective 
than the same total amount of time devoted to group meetings 
of teachers; that, of four programs of supervision, the order of 
effectiveness in producing desirable results is: supervision by 
classes, supervision by schools, inspection of schools, and no 
supervision. 

In connection with the above major findings, these generaliza- 
tions are pointed out: (1) that the following types of supervisory 
activities have proved effective to teachers: demonstration 
teaching, group meetings, personal conferences, building the 
course of study; (2) that the aids most welcomed by teachers 
are: constructive suggestions, constructive: criticisms, and defi- 
nite outlines of work dealing with methods, management, sub- 
jects, and materials of instruction; (3) that the teachers prefer 
the following characteristics in their supervisors: willingness to 
offer encouragement, sympathy, executive ability, open-minded- 
ness, codperation, and tactfulness. The generalizations enumer- 
ated in the previous sections constitute the small body of 
scientifically established facts known about the various phases 
of supervision and supervisory activities. While they are spoken 
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of as scientifically established, it might be well to add that, near 
the close of the chapter in which the summarization of the in- 
vestigations is made, one finds the statement (page 67): “In 
spite of the research achievements of the many investigators, 
most of the irrefutable information has yet to be obtained.” 
The existence of this condition should indicate the future prob- 
lems confronting the membership of this Department. 


Tue Cueck List ror Use IN A SUPERVISOR’S SELF-ANALYSIS 


The check list presented near the close of the yearbook was 
prepared to illustrate a device for enabling a supervisor within 
a given system to make a self-analysis of his work. It is merely 
illustrative and is under no circumstances to be considered ideal. 
In presenting it, the committee realized that the accepted 
philosophy of education in any given school system will deter- 
mine just what items should be included in the list and the rela- 
tive values given to each. 

The committee feels that each supervisor should in some 
measure make a self-analysis of his work. As pointed out in 
the discussion the check list, even though some items may have 
been omitted, contains more items than would ordinarily be 
used. As presented, the items by no means have the same value, 
but the committee felt that the usefulness of the check list would 
be greatly enhanced if the attempt at giving numerical values 
were omitted. The check list is presented in the hope that the 
broad nature of the work of the supervisor may be thoroughly 
comprehended and that in using some such device for self- 
analysis those responsible for supervision may discover their 
own strengths and weaknesses and thereby be stimulated to 
greater efficiency of service and to continuous professional 
growth. 

Cask STUDIES 


Two types of case studies are presented in this report. The 
first type describes how a supervisor has helped a teacher achiev- 
ing unsatisfactory results to attain more satisfactory results. 
The case study reports include descriptions of the teachers’ in- 
structional behavior before any supervisory efforts had been ex- 
pended, accounts of the supervisory activities and suggestions, 
and descriptions of the teacher’s instructional behavior after re- 
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ceiving the benefits of supervision. While the case study reports 
given are valuable, they would have been even more helpful had 
they been more detailed and specific. It is ventured that it 
would prove very helpful to supervisors if they would record 
with meticulous care the detailed facts involved in the analysis 
of a teacher’s instructional behavior before and after the period 
of supervision and the specific supervisory suggestions made dur- 
ing this period. If each supervisor of this Department would 
attempt one such case study, there is every reason to believe 
that the efforts would be a source of great professional stimula- 
tion to those undertaking the case studies and that the pooling 
of the results would be a real contribution to all interested in 
supervisory activities. 

The second type of case study reports are those by super- 
visors relating to how they haye introduced and maintained 
their supervisory programs within their respective cities. These 
accounts contain many interesting suggestions. They show that, 
while the problems confronted by each supervisor in his respec- 
tive city have a distinct local color, the fundamental principles 
involved are the same and many of the devices employed are 
similar. These detailed accounts should be welcomed by the 
membership of the Department. 


Future PrRoBLEMS IN THE EVALUATION OF SUPERVISION 


After consideration of the content of this yearbook, the writer 
wishes to offer a few suggestions for consideration concerning 
the problem of the evaluation of supervision. 

The first suggestion is that, if supervision is to be adequately 
evaluated, there must be better experimentation and a great deal 
more of it. When the statements of the established facts con- 
cerning the effects of supervision were made, a modifying quota- 
tion was added to the effect that none of the generalizations 
were irrefutable. This statement should present a challenge to 
the membership of this Department. In connection with future 
investigations, emphasis should be placed upon supervision as the 
variable. A review of the literature and of the studies reported 
revealed a paucity of investigations in which results from equiva- 
lent groups having or not having supervision were compared, and 
of investigations comparing the relative effects of supervisory 
devices and plans of supervision. There was no experimenta- 














SUMMARY AND CONCLUSIONS 145 


tion showing the relative effects of various combinations of su- 
pervisory techniques or the order of their use; no investigations 
showing the types of supervisory activities which should be per- 
formed by the various supervisory agencies within a school sys- 
tem; and only one or two investigations attempting to measure 
the effects of different philosophies of education on the results 
of supervision. The need for the types of investigations 
enumerated points the way for future experimentation and in- 
dicates the possibility of another yearbook when the suggested 
investigations come to fruition. 

The second suggestion is that the supervisors and directors 
of instruction must realize that the final evaluation of super- 
vision is a codperative enterprise involving the superintendents of 
schools, the principals of the different units of the school sys- 
tems, and the teachers, as well as the supervisors. The codpera- 
tion of all these agencies would probably insure a higher type 
of experimentation than that which has been reported. In fact, 
with some of the experimentation proper experimental condi- 
tions are impossible without such codperation. Furthermore, 
without it the types of experimentation are apt to be confined to 
investigations of small import and to involve few subjects and 
poorly controlled conditions. In offering this suggestion the 
plea is being made for bigger and better experimentation which 
will lead to well-established conclusions. 

The third suggestion is that, if supervision is to be properly 
evaluated, more investigations involving creative supervision 
must be conducted. Just as research can be divided into routine 
and creative research, supervision can be divided into routine 
and creative supervision. Routine research or supervision deals 
with established ways of doing things; creative research or super- 
vision, with the discovery of new methods or values. To the 
writer, much of the experimentation on the evaluation of super- 
vision is suggestive of routine methods of evaluating routine 
activities. It is true that at times this application of routine 
methods of evaluation is all that might be expected, but it seems 
highly important at this time that investigations be made for 
discovering new methods of teaching, new methods of organiz- 
ing subject matter, new values to be derived from given kinds 
of teaching, and new methods of measuring the effects of teach- 
ing or supervisory activities. This plea is made on the convic- 
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tion that, since the most important phase of supervisory activity 
should be creative, a most important phase of evaluation must 
deal with this creative aspect of the supervisor’s activities. An 
excellent topic for a future yearbook might be, “Methods of 
Stimulating and Measuring the Creative Efforts of Supervisors.” 
In a sense, this problem might be termed an administrative 
problem in that it involves the machinery of organizing and 
handling the supervisory staff, but it is also of great signifi- 
cance for consideration by those engaged in supervisory activities. 

The fourth suggestion is that, if supervision is to be properly 
evaluated, those employed in supervisory capacities must be 
trained in experimental methods and in the use of experimental 
procedures. As previously pointed out, many of the published 
investigations and many of those reported were decidedly lack- 
ing in experimental procedures. It seems to follow that, if those 
assuming responsibility for supervision accept as a part of their 
work the responsibility for stimulating and directing experi- 
mental work designed for purposes of evaluation, then teacher- 
training institutions must assume responsibility for guaranteeing 
a type of preparation which will enable the prospective super- 
visor to do this type of work in a satisfactory manner. For 
the sake of avoiding dogmatism in this suggestion, it is proposed 
that its acceptance be postponed until after a thorough job- 
analysis of the duties of effective supervision has been made. 
If such an analysis should show that one essential portion of a 
supervisor’s duties involves experimentation, then the demand 
for adequate training for such work is imperative. The results 
of a few attempts at making a job-analysis of the supervisor’s 
duties are available, at present, but there is still room for a 
yearbook on the topic, “Training the Supervisor for His Work.” 
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